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The measurement of puu'er spectra is a problem of steadily increasing im- 
portance which appears to some to be primarily a problem in statistical esli- 
mation. Others may sec it as a problem of instrumentation, recording and 

analysis which vitally involves the ideas of transmissio7i theory. Actually, 
ideas and techniques from both fields are needed. When they are combined, 
they provide a basis for developing the insight necessary (i) to plan both the 
acquisition of adequate data and sound procedures for its reduction to mcan- 
ingfid estimates and (ii) to inlerpret these estimates correctly and usefully. 
This account attempts to provide and relate the necessary ideas and tech- 
niques in reasonable detail. Part f of this article appeared in the January, 
1958 issue of The Bkll Kystkm Techxical Journal. 
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Details and Derivations 

III this part wo will reconsider some of the earlier analyse, either in 
greater detail, or from alternative points of view. We shall assume 
familiarity with the material on fundamental Fourier techniques pre- 
sented in Appendix A of Part I. 

The sections of this part will be numbered in exact correspondence 
with the sections of the general account. Thus, for example, Section 
B.7, below, presents the details and sidelights related to Section 7, 
of Part I. (Certain sections mil be omitted.) 

B.i Gaussian Processes and Moments 

There are two common modes of description of a random process, 
intuitively quite different. One uses the idea of an ensemble, the other a 
function of infinite extent. The first is undoubtedly more flexible, as it 
can describe processes, even non-stationary (e.g. evolving) ones, which 
cannot be described by any .single function, even one of infinite extent. 
The first is also, at least in the eyes of the statistician, more funda- 
mental, since uncertainty, which he regards as a central concept, enters 
directly and expUcitly. It is possible to regard the single-function ap- 
proach as an attempt to minimize recognition of the statistical aspects 
of the situation. Once, such minimization may have been of some value, 
but today the essentially statistical nature of communication, be it of 
symbols, voice, picture or feedback information, is well established. The 
communication engineer is aware that he must have designed not only 
for the message which was sent, but also for the one which might have 
been sent — moreover that his design demanded consideration of the 
relative probabilities of various messages that might have been sent 
(and were not). 

Such a statistical view of message or noise confronts us with the need, 
not only of picking out what functions might arise, but also of attaching 
probabilities to functions (at least to sets of functions). To do this di- 
rectly and completely requires much careful mathematics. As far as 
questions associated vnih observations and data are concerned, there is, 
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fortunately, no need for such care and complexity. We know that any 
empirical time function can be adequately represented by some finite 
number, large or small, of ordinates. Thus, for practical purposes, it 
suffices to be able to assign probabifities to sets of ?i ordinates — for n 
finite but possibly quite large. It is for this reason that we went directly 
to probability distributions of such n-dimensional sections in the general 
account. 

This replacement of a continuous record by discrete ordinates is re- 
lated to the sampling theorem of information theory. The relationship 
is, regrettably, not quite simple. Given a band-limited "signal" defined for 
all time from — oo to + =» , and moderately well-behaved otherwise, 
the sampling theorem (Nyquist^^), which is also known as the Cardinal 
Theorem of Interpolation Theory (Whittaker ), states that equi-spaced 
ordinates, if close enough together, extending from — <x> to + <» will 
precisely determine the function. Given a band-limited function over a 
finite mterval, the corresponding result is almost practically tnie. It is 
not true in a precise impractical sense, since every band-limited function 
can be obtained from an entire function of exponential type (of a com- 
plex variable) by considering only the values taken on along the real 
axis. Consequently, if we know a band-limited function precisely in an 
interval, its values are determined everywhere. Theoretically determined, 
but not practically so, smce the kernels expressing this determination 
behave like hyperdirective antennas. Since the values at equi-spaced 
points in the interval do not determine the values at equi-spaced points 
outside the interval (which would be detemiined by precise knowledge 
throughout the interval) the latter cannot be obtained from the equi- 
spaced values in the interval. In practice, however, functions are not 
quite band-limited, and measurements always involve measurement 
noise. When these two facts are considered, a sufficiently closely spaced 
set of equi-spaced ordinates extracts all the practically useful informa- 
tion in the continuous record. 

The fact that averages, variances and covariances completely charac- 
terize any ?i-dimen.sional Gaussian distribution is common statistical 
kTiowledge, and follows by inspection of the conventional general form 
of Gaussian probabiMty density function, in which these moments ap- 
pear as the only parameters. 

D.2 Autocovariance Functions and Power Spectra for Perfect Information 
If X{l) is a function generated by a stationary Gaussian process, and if 

hm ^ Kit) dt ^ Q (B-2.1) 
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then the autocovariance funclion of the process is 

C(t) = lim I r X{t)-X{l + r) dl. (B-2.2) 

III particular, the variance of the process is 

('(0) = lim i f' [X{t)Vdt. (B-2.3) 

r-.M i J-r/2 

If the function X(l) is paswed through a fixed hnear network whose 
impulse response (response to a unit impulse applied at I = 0) is W{t), 
then the output of the network will be 



X 



At) - I wi\)-x{t - \)-d\, 

J— 00 



and the autocovariance of the output mil be 

CUr) = lim^ f' f f W(\d-Wi\,)-Xit - Xi) 

T-ftO i "'-Tit •'—00 J— CO 

■X{t + r - \2)-d\i-dK2-dt 

- r r inxi)- 1^X2) -0(7 + Xi-X2)-t;x, -dXa. 

J— 00 J— CO 

If we now let 

C{t) = r PifW"' df (a) = 27r/), (B-2.4) 

then 

rout(r) = f r f ll'(Xi)-lK(X.)-P(/)-c'""+''-'^'-rfXi-(iX,-t//. 

But 

r Tr(X2)-e^'"'^-dX2 - y(/) 

is the transfer function (ratio of steady-state response to excitation, 
when the excitation is c'"') of the network, and 

f TnXi)-e'"'^-dXi= Y{-f) 

is the complex-conjugate of Y{f). Hence, 

CUr) = r 1 !'(/) r ■P(/)-e''*^'-df. (B-2.5) 



490 THE BELL SYSTEM TECHNICAL JOUHNAL, MARCH 1958 

In particular, the variance of the output is 

CUO) - r I Y(f) \'-P(f)-df. (B-2.6) 

tl — oo 

Since I Yif) f is the power transfer function of the network, it is natural 
to call P(/) the power spectrum of the process. The power spectrum has 
the dimensions of variance per cycle per second. By equation (B-2.4) 
we have 

P(f) ^ r C(T)-c~'-'dr, (co = 2x/), (B-2.7) 

J— CO 

and, by equation (B-2.5), 

^out(/)- \Y{f)f-P{f). 

Autocovarianee functions and power spectra are usually regarded as 
one-sided functions of lag and frequency, respectively, related by the 
formulae (Rice^ p. 285), 

Pif) ^ 4 / C (t) ■ v^oa COT • dr , (not used here), 

Jo 

C(t) = I P{f) -uotiwr-df , (not used here). 

However, we will find it very convenient for analytical purposes, to 
continue to regard them as two-sided even fimctions related by equations 
(B-2.4) and (B-2.7). This will be evident in Section B.4 where spectral 
windows will be convolved with power spectra, and in Section B.6 

where we wo^lld otherwi.se have to make use of rather complicated trigo- 
nometric identities. 

In a few places where we contemplate computations, we may write 

P(f) = 2 [ 0(7-) -cos o^T-dT, (o) = 27r/), 

Jo 

instead of equation (B-2.7), but it is important to observe that the power 
spectrum P(J) thus obtained must still be regarded as a two-sided even 
function which contains only a half of the total power or variance in the 
positi^'e frequency range. If we prefer to think ultimately of a one-sided 
power spectrum (over only pasitive frequencies), in accordance with 
engmeering practice, then we should take 2P(/) as the power density 
(per (^ycle per second) for positive frequencies. 
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The power spectmin P(f) may jiLso be expressed directly in terms of 
X{t). The forma! derivation of this expression on the basis of fhv, fornmla 
(B-2.2) for the autocovariance fiinftion ir> complieated by the fact that 
the integral 

{ X(t)-X(t-\- T)dt 

actually depends upon two more-or-less distmct pieces of X{t), one in 
the range — T/2 < t < T/2, the other in the range 

T T 

We may a\^oid this complication by using tlie equivalent formida 

C{t) = \im\J G{t)-G{t + T)-dt, (B-2.8) 



where 



Let 



so that 



I'hen 



G(t) = X(t) , M I < I ' 

= 0, \t\>^. 



S(f) = r G(t)-e~''''dt, 

J— 00 

G{i) = r su)->r'dj. 

C{t) - Hm \, r GiD-f Sif)-e''"^'+'' df-dt 

7'-»oo I J— CO •'—CO 

= \iml r SU)-e'^- r GiO-e'^^'dt-df 

T-"X> I J— CO J—ao 

^ lim^, r S{f)-S{-f)-e-dJ. 

T-taa 1 J— CO 
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Comparing with (B-2.4) we get, at least formally, 

T-*co 1 



r-vco i I J—ai 

= limi X(t)-e~-' 



(B-2.9) 



di 



-Tl2 

(Sec Rice,^ p. 320, and Bennett,''^ p. G21.) 

B.3 The Practical Situation 

In the study of second moments of random processes, the balance 
between the approach through autocovariances and the approach 
through power spectra is, in at least one sense, a little closer than Sec- 
tion 3 would seem to imply. As a means for understanding, and as a 
guide for intelligent design, the power spectrum is without a peer. The 
autocovariance function is of little use except as a basis for estimating 
the power spectrum. This is fundamentally because, in most physical 
systems, power spectra have reasonable shapes, are relatively easily 
understandable, and often are quite directly influenced by the basic 
variables of the situation, whatever these may be. The process of 
using an empirically observed and analyzed power spectrum usually 
goes through some such chain of steps as this: 

(i) Planning and design. 

(u) Observation and recording. 

(iii) Analysis and preparation of estimates. 

(iv) Comparison of estimates with existing and synthesizable theoreti- 
cal sti"uctures and quantitative information. 

(v) Selection of the best working version of a theoretically-guided 
approximation to the estimates. 

(vi) Use of this working version. 
Our theoretical understanding of the situation, and of the forces in it, 
play important roles, which we should never allow ourselves to forget, 
in steps (i) and (v). (We use this understanding to the utmost, in its 
proper place, but we do not, and should not, ahow it to narrow down 
steps (ii) and (iii) to the point where we have little or no chance of dis- 
covermg that it was incomplete or in error. Thus, we estimate a consider- 
able number of smoothed spectral densities, and not merely a few con- 
stants of a suggested theoretical curve. After we have compared curve 
and points, we may then wish to estimate the constants.) 
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The simplest and most straightforward use we can make of the power 
spectrum is to predict the output spectrum, or perhaps only the output 
power, \^'hen the process studied pro\-ides the input to a hnear device with 
a known power transfer function. 

Except for purely descriptive uses, checking on performance for agree- 
ment with anticipation, and for predictmg the behavior of already de- 
signed hnear systems, the most elementary use of a power spectrum hes 
in optimizing the performance of some hnear predictor or filter as meas- 
ured a la least squares. The nature of this situation is not quite that one 
which most persons imagine. 

If we really have no theoretical insight hito the situation at all, we 
might as well (nay, perhaps, might better) stay in the time domain. 
We have autoco\'ariances (say) for some limited range of lags. If the 
duration of the transient response of our filter or predictor is not going 
to exceed one-half this time limit, then we can write out the estimated 
variance of any predictor or filter directly in terms of our estimates of 
autocovariances and of the time description of the filter or predictor, 
and could then minimize this directly. With no theoretical uisight this 
should work at least as well as any other way. With no theoretical in- 
sight, analysis in the tune domain would be relatively good, perhaps 
even optimal- — -and probably absolutely poor. 

But we do not, and ahnost always should not, optimize filters or pre- 
dictors in this way. The reason is simple. Actual power spectra are often 
simple and understandable. Actual autocovariance functions are hardly, 
if ever, simple and understandable. The intervention of theoretical in- 
sight and human judgment at step (v) is ciiicial and valuable. This in- 
tervention is effective in the frequency domain, but not in the time 
domain. (Step (v) is likely to stand for some time, as a challenge to the 
ability of statisticians to wisely and effectively automatize inferential 
procedures.) 

An additional advantage of power spcctnun analysis over autoco- 
variance analysis was pointed out in Section 3, namely the ease of com- 
pensation for (hnear) modification before measurement. When the 
random function X(t) is passed through a time-invariant hnear trans- 
mission system whose impulse response is W{t), the output random 
function, which may be the only function accessible for measure- 
ment, is 

XUt) = {_ W{r{)-X(t- n)dT,. 

The relation between the autocovariance Contir) of the modified process. 
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jiiid the aiitocovariance C(t) of the original process may be derived as 
follows : 

CoutW = ave {Xout(t)-XoUt + r)] 

DO 

Ij W(Ti)-X(t - ri)-X(t + T - T2)-W(t2) dr, dr^l 



= ave 



= jj W(ti)-C{t + n - T2)-W(t-^ dridr.. 

Putting 72 = Ti + X, we get 

C'oat(r) - r C(r - X) ■ r f T7(ti) ■ W{t, + X) drA d\ 

J — 00 ** — CO _J 

- C(t) * W(r) * W(-r). 

Measurement of Xout{0 can give estimates of Coui(t) which must subse- 
quently be converted into estimates of C{t). The only practical way to 
make this conversion seems to be through Fourier transformation of the 
estimates of Coutir) into the frequency domain, compensation there, 
and Fourier retransformation. Such a procedure, in effect, invokes the 
relation between the power spectrum Pout(/) of the modified process 
and the power spectrum P{f) of the original process. This relation is 

PUD = p(f)-\y{i)\\ 

where !'(/) is the transfer function corresponding to the impulse response 

W{t). 

Details for Continuous Analysis 

B A Power Spectrum Estimation from a Continuous Record of Finite Length 

In the ideal case considered in Section B.2, which assumes that wc 
have an infinite length of X{t), we can calculate the power spectrum F(/) 
in two ways ^either directly from X{t), or indirectly as the Fourier 
transform of the autocovariance function C(t) which is calculable di- 
rectly from X(i). The basic choice is, leaving limiting problems aside, be- 
tween sqiLaring a l''onrier transform, or Fourier transfoi-ming an aver- 
age of products. In either case multiphcation and Fourier transforma- 
tion must enter. 

From the point of view of the ensemble, as opposed to the single time 
function, we seek to estimate a particular basis for the second moments 
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of fill linear combinations. We may estimate any convenient basis as a 
start, and then transform. 

Clearly, from either point of \'iew, any result obtained in one way can 
also be obtained in the other. Differences between a time approach and a 
frequency approach must be differences in (i) ease of understanding, 
(ii) ease of manipulation of formulas, (iii) ease of calculation with num- 
bers, rather than in anything more essential. 

Understanding and a simple description of the procedure which yields 
reasonably stable estimates, and which we have discussed in general, is 
more easily obtained by the indirect route, so we shah proceed accord- 
uigly, beginning with a general outline of a hypothetical procedure for 
power spectrum estimation from a continuous record of finite length. 

A general outline of a hypothetical procedure for power spectrum 
estimation from a continuous record of finite length, specifically X{t) for 
- T„/2 ^ t ^ 7'„/2, is as foUows: 

(1) Calcidatc the apparent auiocovariance function 

1 .(T„-|rl)/2 / _\ / t\ 

CM = rr I , ^U- I) -^{^ +^ dt (B-4.1) 

in — \t \ J-{7-„-|t|)/2 \ 1/ \ Z/ 

for I T 1 ^ ^Tm < Tn, where T^ is the length of the record, and T^ is 
the maximum lag to be used. We shall see in Section B.9 that the 
stability of our power spectrum estimates depends upon how small wc 
take the ratio T,JTn ■ 

(For the purpose of the theoretical analysis in this section we assume 
that t.he data contain no errors of measurement; in particular, no bias 
due to a displaced (perhaps drifting) zero. The effects of such errors 
are considered elsewhere.) 

(2) Calculate the modified apparent auiocovariance function 

Ci(r) - Diir)-C,,(T), (B-4.2) 

where D,(r) is a prescribed lag window, an even function such that 

^.(0) - 1 , 
and 

jr),(r) =0 for ] r j > r„ . 
Note that Ciir) = for | r | > T„, although Coo(t) is not available for 

(3) Calculate the estimated power spectrum 

P,(/) = 2 [ C',(t) ■ cos wr- dr. (B-4.3) 

Jo 
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Our object is now to determine the relation between ave {Pi{f)] and 
P(f), where "ave" denotes the ensemble average, that is, the average 
over all possible contuiuoiis pieces of X{i) of length T„ . (The variability 
(specifically, the variance) of Pi{f) will be examined in Section B.9.) 
Since Coo(t) is not calculated f or | r | > T,„ , it is clear that 

ave {CUr)] - C{r) , only for ] r | < 7',,, . 

However, because Di{T) ^ for [ r | > T„, , 

ave [Ciir]] - Di{T)-C{r), for any t. 

Hence, 

ave{Pi(/)} = £ Z)i(T)-C(T)e-'"^dr. 

Then, if Qi{j) is the Fourier transform of DiCr), the relation we seek is, 
symbolically, 

ave{P.-(/)} ^ Qi(f)*P{n, 

or explicitly, 

ave {P,(/i)! ^ r Q.ifi - f)-P(f) df. (BAA) 

J— to 

This relation is in a form, (B-2.6), which is fumiUar to communications 
engineers except for the fact that Qi(fi — /) is not an even function of /, 
when /i ?^ 0, and may be negative in some ranges of /. However, taking 
advantage of the fact that P(f) is an even function of /, we may write 

ave{Pi(/i)I ^ f HiU\h)-PU)dj, (B-4.5) 

where 

Hi{J;h) - QiU + /i) + QiU - fO- (B-4.6) 

The function Hi{f; /i) is an even function of / as well as of /i . Hence it 
satisfies one of the necessary conditions for a physically reahzable pawn- 
transfer function. However, inasmuch as it may be negative in some 
ranges of / (actually an advantage as we will see), it may still not be 
physically realizable. Nevertheless, it is convenient to regard Hi{j; /i) 
as the power transfer function of a network, and to regard ave {Pi{f\)] 
as the long-time-average power output of the network when continuously 
driven by the random process. 
Since Pi(/i), whether calculated from a single piece of X{t) as outlined 
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above, or calculated as an average over a finite number of pieces of X{t), 
is an estimate of avc [P,(/i)} in the usual statistical sense, it is evident 
that the calculated power density P,(/i) is an estimate of an average- 
over-frequency of the tnie power spectnim P(f), and not an estimate of 
the local power density P(/i). The calculated power density Pi(fi) may 
be regarded as an estimate of the local power density P(fi) only to the 
degree to w'hich Q,{/) approximates 8(f). However, under the restriction 
that Diir) ^ for I T i > T,„ , the degree to which Qi{f) approximates 
8{f) depends chiefly on ho^v large we take Tm ■ On the other hand, as 
we will find in vSection B.9, the larger we take T^/Tn the less stable 
will the estimates be. Hence, in general, it will be ■wasteful to demand 
more frequency resolution than we actually need. In many cases we 
may even have to take less frequency resolution than we would like to 
have, in order to secure a reasonable stabihty of the estimates. Clearly, 
for any specific value of Tn , (and iiumber of pieces of record), we can 
increase frequency resolution {or stability) only by sacrificing stability 
(or frequency resolution). 

We have just examined a hypothetical method of power spectrum es- 
timation, in which w^e compute an apparent autocovariance function, 
modify it, and take the cosine transform. We will now examine a method, 
also hypothetical, in which we modify the data, take the sine and cosine 
transforms, compute the sum of the squares at each frequency, and 
divide by the length of the record. If the data is X(t) for Q < t < T^ , 
and the w^eighting function (data window) is Bi{l), the estimated power 
spectrum is computed essentially accorduig to the formula 



PM) = 7^1 r Bi(t)-x(t) 



dt 



(B-4.7) 



To determine the average it is convenient to assume that X{t) is of un- 
limited extent, to specify Bi{i) to be identically zero for t < and 
t > Tn , and to allow the data window Bi{t) to be located anywhere in 
time by substituting Bi{t — X) for Bi{t). Then 

PM-X) -^\r Bi(t - X)-X(0-e^'"' dt \ (B-4.8) 

This is the Fourier transform of 

CAt;\)^~ r BS--K)-X(t)-Bi(t-\-\-r)-X{t + r)-dt. (B-4.9) 

ICompare with (B-2.8) and (B-2.9)]. Now, since the random process is 
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stationary, the ensemble average is equivalent to the average over X; 
that is, 

ave {C.,(r)t - lim- CrAr;\)-d\. 

T-.0O i J—t!2 

Substituting {B-4.9) and \ = t — ^ into the right-hand member, we get 
ave{a.(r)} -^-limi f X{t)-X{t + T) 

i n T-*CB i- J— XI 

Reversing the order of integration we get 

• lim 4 / X{t)-X{t + T)-dt d^. 

The quantity in brackets is the tiiic autocovariance function C(t). 
Hence, 

avc {CUt)] = DM)-C{r) (B-4.10) 

where 

DM) -~ f B^-B^i^ + r)-d^ (B-4.11) 

is the lag window equivalent of the data window Bi{t). Therefore, 

ave{P.,(/)} =QM)*P{1) (B-4.12) 

where Qdij) is the spectral window corresponding to (i.e. the Fourier 
transform of) the lag window D^). 

If J i{j) is the frequency window corresponding to (i.e. the Fourier 
transform of) the data window Bi{i), then 

QM) = ^ I JiU) r- (B-4.13) 

(It will be noted that (B-4.10) can be obtained more directly from 
(B-4.9), by taking the ensemble average of the right-hand member of 
(B-4.9). In this case, X is superfluous and need not have been intro- 
duced at the start.) 

These formulas for the "direct" method, where Fourier transforma- 
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tioii (hiTc modified by the data mndow) precedes multiplir.'ition (here 
s([ii:iri)ig) ran he used in se\eral ways. Let us consider three possibilities: 

(ii) we may choose B,(i) non-zero over as long a range as po'^sible, so 
that lK,{r) will be broad and Q^df) narrow, 

(b) we may choose ^,(0 non-zero over a much shorter range, making 
T^eiir) not so broad and Qdij) not so narrow, 

(e) we may choose a number of such short \\indows, use each for 
Bi(t) and u\'enige the (-orresponding values of Pei{j) so obtained into a 
general average. 

If we follow choice (a), our result will behave similarly to those ob- 
tained from the indirect method when we try to make Qi{j) like 5(/). 
We shall estimate an average over a very short frequency interval, and 
our estimate will be excessively variable. 

If we follow choice (b), we shall estimate an average over a wider fre- 
{juency interval, but our estimate will remain just as variable. 

If we follow choice (c) our estimate will refer to the same sort of 
smoothing as in (b), but we shall gain increased stability for the estimate. 
The behavior of the estimate will resemble that of a reasonable estimate 
by the indirect route. 

Finally, there is another way in which we can apply the formulas for 
the direct route. We may use a long data window, calculate many values 
of Peiif), :ind then average these results over moderately wide frequency 
intervals. Again our estimates will be estimates of considerably smoothed 
spectral densities; again our estimates will be moderately stable. 

Of all these, the siniplest dosci'iption of an estimate which is moder- 
ately stable, and must, consequently, be an estimate of an at least mod- 
erately smoothed spectral density, is the indirect route. We shall stick 
to the indirect route for the present. 

B.5 Particular Pairs of Wrnd(yws 

III this section we will consider five pairs of windows. They are il- 
lustrated in Figs. 1, 14, and 15. We begin with the 
Zerolh Pair 

a(r) = 1, 1 T I < T„. , 

= 0, 1 r I > r. , 



and 






Notice that Co(t) ^ Z>u(t)-Coo(7-) coincides with Coo(t) wherever Cqo(t) 
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is defined, and vanishes elsewhere. This is a "do-nothing" ]5air. How- 
evci", Qoif) is neither simple nor well-behaved, the first side lobe on each 
side of the main lobe being abont- I the height of the main lobe (and 
negative). 

The specifications of the other four pairs are : 

First Pair (Bartlett^) 

/)i(t) ^ 1 - LlJ , \r\ < T... , 

= 0, I T I > T,.. , 



and 



Qiif) = r„ 



sin TfT,. 



Second Pair (sometimes called "banning", after the Austrian me- 
teorologist Julius von Hann) 



= 0, 



\r\ > T., 



and 



Q2{f) = \ Q.U) + \ 



^.,(; + _i_)+Q,(,_A. 



Third Pair (sometimes called "hamming", after 11. W. Hamming^^) 



Dsij) = 0.54 + 0.46 cos 



-t Ml 



-0, 



\r\> T,,., 



and 



Q,(f) = 0.54Q„(/) + 0.23 



^"l-^ + i) + ^^"(^^2i 



Fourth Pair (RBB's not very serious proposal) 
D,(r) = 0.42 + 0.50 cos ^ + 0.08 cos ^ , 
= 0, 



T I < T„, , 

I r I > 7' 
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and 

Q,(f)= 0A2Qn(f) +0.25 

+ 0.04 
These Hpccificatioiis are all special cases of 



Qo (/ + ^) + Q'^ (/ - ^ 



-Di(t) = a,ii +22 a,j cos ^ , | t | < 3' 

)=1 -1 in 



"1 ) 



with 



who nee, 



= 0, \t\> 3',„ , 



«>o + 2 ]C oo ^ h 



Q.(/) - «.n^o(/) + E «,; [^0 (/ + 2^~) + ^A (/ - 2^) 

The cocfTicients in />,i(t) may he regarded as convenient approxima- 
tions to 

25 _ 21 

which would have produced a zero of QaCf) at [ / 1 = 1 .25/T„ , with other 
zeros occurring at all integral multiples of O.o/T^ except at and 
zhO-S/T^ . (The zero which could have been produced at | / i = 1.25/T„ 
actually occurs at approximately |/| = l.S/T^.) The coefficients in 
1)3(7) were actually selected to minunize the height of the highest side 

lobe. 

The coefficients in D^ir) are convenient approximations to 

_ 3969 _ 1155 _ 715 

""" ~ 9304' "" ~ 4652' "'' 18608' 

which woidd have produced zeros of Qi{f) at j / | = 1 .75/7 „ and | / ! ^ 
2.25/7'm , with other zeros occurring at all integral multiples of 0.5,/T„, 
except at 0, ztCS/T*™ , and ±l/3',„ - 
In view of the fact that 

Di(T)-DoiT) = D^{t), 
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we have 

QiiD * Qoif) = Qi(f), 

relations which may be of interest, as may the fact that using 
Di{T)-Dj{T) for the lag window corresponds in general, to a spectral 
window Qiif) * Qjif). 

The writers have spent considerable time and effort inquii-ing into 
other possible window pairs. One of the most promising approaches was 
that of Ceby^ev or Chebyshev polynomials (see Dolph") to obtain side 
lobes of equal height. Their present conviction is that: (i) special win- 
dows cannot eliminate the need for prewhitening and rejection filtration 
and (ii) good prewhitening and rejection filtration can ehminate the 
need for special windows. Accordingly they do not recommend expend- 
ing extensive effort on special windows. 

Readers famihar with physical optics will recognize the close relation 
between the considerations of this section and diffraction by shts of 
unifonn (t = 0) or varying (i = 1, 2, 3, 4) width. The literature on 
apodization (Jaquinot,^^ Boughon, Dossier, Jaquinot^^) is relevant. 

B.6 Covariability of Power Density Estimates — Basic Result 

To derive a formula for the covariance of two power density estimates 
Piifi), Pjifi) obtained from the same record, we will first derive a formula 
for the covariance of M(ti , n), Mifi , t^) where 

W,.)=x(/-r).x (( + :). 

For this we will use a formula for 

cov \wx, yz] = ave [wxyz] ~ ave {wx} ave {yz] 

dating back to Isserlis,^ and used by Hotelling^' in a similar coimection. 
If w, X, y, z are joint Gaussian variates with zero averages, then 

cov ( lox, yz ] = ave [wy] ■ ave {xz] -\- ave {wz] • ave {xy}. 

(This result is easily derived from the "characteristic function".) If we 
take 
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and make use of 

ave |x (i - ;^X (i + ^)} ^ C(r) = £ Pif)-e^- df 

we get 

cov {M(ti,Td,M{k,r2)] =- 

ff r t(co,-..|iKTi-T2)/2 _|_ ^t{<oi-a.2)(Ti+7s)/2j (B-O.l) 

It may be noted that 

var {[X{t)Y] = cov {Mit,Q), Mit,0)] = 2 £p(/)-d/J , 

while 

avellXCOn = r Pif)-dl 

J— CO 

Henne, 

2-[avel[X(0rjr 



vari[X(0?| 



= 1, 



in accordance with the fact that [X{i)f is a constant multiple of a chi- 
sqiiare variate with one degree of freedom. 

Substituting /i = /' + /Ja = /' - /, and noting that dfrdf2 = 2df-df', 
we get 

cov {M(tl,Tl),M{t2,T2)] = 

I r [g-(n-,, _^ e'-"(^'+^^'].4>(/,ii - U)-df, (B-G.2) 

2 J— DO 

where 

$(/, X) ^^r Pif + f)-P(f' - f)-e-'""^ df. (B-fi.3) 

J — CO 

Since *(/, X) is an even function of / we may replace e'"'''=^'2^ by 
cos c.(ti ± T.), and since P(/' + /) ■ P{f - /) = P(f + /') -P(/ - /') is an 
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even function of /' we may replace e"'^"' by cos 2aj'X. Hence, we have 

GOV [M{k,ri),M(t2,T-2)} = 

I COS coTi-cost<)T2-$(/, ti — t2)-dj, (B-().4) 
where 

$ax) = 4 r P{J -\-f')-P(f -j')-coH2^'\-df. (B-(i.5) 

The next step is to determine the covariiuice between Cuiri) and Co{T-i). 
By definition, and for hypothetical computation, 

1 nlT„-\T])/2 

Coir) = „, I I / M(t,T)-dt, (B-6.6) 

but this is inconvenient for present purposes on account of the depend- 
ence of l3oth the limits of integration and the divisor upon t. A more 
convenient form would be 

Coir) =^ r Mit,r)-dt, (B-G.7) 

where 7'n S T^ — T^- This fonn could actually be used for computa- 
tion, but it would not make the maximum possible use of the data. The 
range of integration in C'(](t) is less than it is in Co(r) for any t except 
possil)ly I T I ^ T,n . A good approximation to the use of C(j(t) for com- 
putation is to regard this as (approximately) equivalent to the use of a 
hypothetical, modified C'nir) with T„ - 7',,. < T^ < T„ . We will take 

T'„ = T^- a/r,„, (B-6.8) 

w^here a,- depends upon the lag window to be used. Since, for each value 
of T, the range of integration in formula (B-6.6) suffers a loss of r out of 
Tn , and since the seriousness of this loss depends on the value of Diir), 
it seems to be a reasonable approximation to take 



1 Jo 



T-Di{T)-dT 



''^ = nr ~T„ . (B-6.9) 

" / DM-dr 
Jo 

which yields, for the first four lag windows described in Section B.5, 
ao = 0.50, «i - 0.33, a.. = 0.30, a-i = 0.33. 
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U.siiig the approximation described iii the preceding paragraph, we 
find (omitting the prime in Co) 

cov {Co(ti),(7o(t2)! - f coscoTi-cosa)rrr(/) (// (B-6.10) 

J— 00 



Avhere 






r(/) --^, // HLh-h)-dtvdk 



-T'ji (B-6.ll) 

= 4 £ P(/ + /')-P(/ - /)• (^^p/'- 

The final step is to determine the eovarianee of /*,{/i) with PjiU), re- 
calling that, for example, 

PiU) = \ C. (r) -cos tur-rfT, 

''-00 

where C',(t) - Di{r)-C,{T). We get 

cov [Pi{h),PAm = \ r HAf;fd-Hj{f;h)-Tif)-df, (B-G.12) 

wliere 

liiU, S\) = 2 / Di(Ti)-eoswTi-cosa)iTi(/n 

J-M (B-H.13) 

= f^.(/ + U) + Q.(/ - /i) 

with a similar fornnila for flj{f;f'i)- In particular, of course, 

\P,(m - I [ \HAf; /.)r-r(/)-rf/. (B-G.U) 



var 



The -pinccr -variance spectrum is gi\'cn by (B-G.ll), and involves tlie 
true power spectrum in an essential way, as we would expect. Together 
with (B-G.12) and (B-0.14), this is the basic result. It is exact for esti- 
mates based on C'o{t), approximate for estimates based on Co(t). 

B.7 Covariahility of EMimntcs — Variovs Approximations 

We now need to ol)taiii a \-aricty of approximate forms of the basic 
result, suitaljle for use under different conditions. We shall, in turn; (i) 
assume that the typical freciuency scale of //,(/; .A) and Hj{f; f-i) is much 
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larger than ^/Tn , (ii) assume that P(/) varies slowly enough for the 
quadratic term in its Taylor series to be neglected at distances up to, say, 
^/T„ , (iii) assume both (i) and an assumption similar to (ii) about 
Pii(f) and PjtU), and, finally, (iv) assume only that P(/) is concentrated 
m a sharp peak, narrow in comparison Avith \/Tn, - 

Combining formulas (B-6.11) and (B-6.12) just obtained, we find 

cov {Pi{ji),Pi{m = 

Hiih /i) -Bsi!; h) -Pif + /') -Pif - n 



I! 



/sino^Y 



(B-7.1) 
■df-df. 



The last factor in the integrand becomes rapidly negligible for | /' [ 
greater than, say, l/7'„ . On the other hand, the t3T3ical frequency scale 
oiHi(f;fi) and//j(/;/2) is l/T™ which is usually much larger than l/T^ . 
In most cases, then, we will find that the approximation 

Hiif; /i) 'H^f; /,) ^ H,(f + /';/,) -Hjif - f;f,) 

is a good approximation for the values of /' making contributions of any 
importance to the integral. Under this approximation, and a change of 
variables of mtegration to 

/(=/ + /', f2=f-f, 

we have, approximately, 

cov {Pm,Pj{f2)] ^ 

IfyWi; fO-Pif'i)-H,{f'r, h)-P{f2) 



[sin Trif'i - /2)rlT , , 

1 .(/;-/Dr; l"'^'''^'- 



If we let 

Pud) = mi-Ji)-P{f), (B-7.2) 

and 

PM = H,{f;f,)-P(J), (B-7.3) 
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then, approxiinately, 

cov U^(/l),PX/2)} 

^2//p.-.(/;).p.(/o{ "rf'-y T<^/.v//^, ^''-'■'' 



u'liich is our approximation on assumption (i). 

In terms of the .same quantities we have, from (B-4.5), 



and 



ave {P,(/01 - [ Pn(f[)-dj[, (B-7.a) 

Jo 

ave(P;(/.)) ^ [ Pdf2)-df2. (B-7.6) 

Jo 

The following heuristic interpretation of the last three formulas is 
useful. Frequency /I is involved in Pi(fi) with a net weight of Pnif'i), 
wiiile frequency /s is involved in Pj(/2) with a net weight of PaiJ-i). 
These are net weights, and might represent partial cancellation. The 
covariancc between Pi(/i) and P 3U2) might involve additional sources of 
varial)ility. To the extent that the approximation to Hi{j; fi)-Hj(f; J-^) 
is valid, there are no additional sources of variabihty ^ — ^ the covariance 
involves the same net weights. The fact that we have only a record of 
equivalent length T'^ is represented by a tendency of the frequency/i' to 
become entwined with the frequency j'l , measured by the factor 

" sin7r(/; -f^YK J 
_ 7r(/i -^f,)T'„ _ ■ 

The fact that there are no additional sources of variability as we pass 
from first to .second moments {to the accuracy of the approximation) i.s 
good evidence that we are using the data in a relatively efficient way. 

If we begin anew from (B-7.1) byexpandmg P(/ ±/') in Taylor series 
around /' = 0, we find 

pu+n-pU'D = \p{f)f-\-(fr-[p{.f)-p"{f) - [p'(/)fi + 

symmetry forcing the odd-order terms, includhig the first, to \-ani.sh. 
Since the trigonometric factor is very small for | /' | > 2 or 3 times 1/T'„ , 
we may often replace P(f + f)-Pif - /') by [P(f)]- to a very good ap- 
proximation. This yields, after integrating out/', 

-* n 
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whence, 

cov {F,(,A)./M/2)I ^^ [ HU,h)-HAf;mPU)\'-dS 

T„ •'0 

our useful approximation on assumption (ii). 

In carrying out this approximation we only needed smoothness of 
P(f) for f's which make a non-neghgible contribution to the final result. 
]f I-Ii(f;fi)P{f) and Hj{j\f'^P{j) are both smooth, as under assumption 
(iii), then P{j) must be smooth except where both Hi{j; /i) and Hj{J\ f->) 
are small, and the contribution from such regions can be neglected. Thus 
our useful approximation for the covariance under assumptions (hi) is 
the same as that imder assumption (ii). (The approximation for r(/) 
need not be so accurate.) 

Finally, if P{f) consists only of a very sharp peak (width <SC 1/7'n) .it 
/ = /o (and, of course, at/ = — /n), with area A, then 

P(f)^A-m-\-Io)-\-8(f-f,)l 

whence, 

r(/) ^ 2A'- ^5{f + /o) + 5(/ - /o) + 2 (^^1^^J.5(/)] . 

Hence, 

cov {Pm,PAm ^^'|/f.(/o;/i)--ff>(fo;/2) 

+ 7/.-(0;/0-^.(0;/.)-(^i^)]. 

which is our useful approximation under assumption (iv). In case 
/o» 1/7',., the trigonometric factor may be neglected, and we may write 



cov 



|Pi(/.), Pm\ ^ (jf" Pnif) '^/)-(jf" Pdf) rf/)- 



B.8 Equivalent Widths 

Under assumption (ii) of Section B.7, i.e. P(f) slowly varying, we 
ha\'e, for the dimensionless variability of P,(/i), 

var {F,(.fi)l ^ ^1_ ,g g ^. 

[ave |P,(/i)n' T'JV.' 
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jll 



where 



If. = 



f[PM)Y-df 



(B-8.2) 



is tfie cquivalcnl width of 



PM) -Hi{f;h)-P{i). 

Wc will now determine the equi\'alent width of P,i(/) under the assunip- 
tiou that, for each vuhie of /i , /^,[(/) is essenti;dly a constant times 
Hi{f\ /i). The vahie of the constant may depend upon the vahie of /i, 
but it will not ha^'e any effect on the ^-aluc of We ■ It is convenient to 
express (B-8.2) in terms of the norraaUzed frequency 



so that 



<p = 2-KfTm, i<Pl = 2TrfiT„,), 

Pa{'p)-d<A 



W.. = 



47rr„ 



f[Pa{<p)?-d<p 



(li-8.3) 



where 



Since 



we get 



and, since 



Qi{^) = (1 - adQM + ^ [Q,{>P + tt) + QyU - 't)], 
flfl = 0, 02 - 0.50, 03 = 0.46. 

[ Pn(<p)-d,fi - 27r, 
sin (ip + a) sin {,p -\- 0) sin (a — 0) 



(B-8.4) 



J— CO 



'-„ ip -\- a ^ + /3 



(/^ ^ 



a - /? 
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we get 

J_ao 

where 

, (-. _ \ fsi n i2tpi - tt) si n (2^i - 

Oi^ f sin 2(v;i - t) . sin 2{<fi + 
"^4 1 2(pi - tt) 2(^1 + X 

Hence, for these windows, 

1 



jr)" 
■) J' 



]^, = 



2T,.B 



It will be noted that 



B = 



2 n ~ 2ar + | aA 



1 



= 1 — tti -\- - af, 

7 
= 1 — 2ai + - a/, 

= 1 ~ 2fli + I aA 



(B^8.5: 



(B-8.6) 



To a close approximation, 



^ = 1 - 2ai-\- -a;\ 



for /i = , 



for /in. = ^, 

for /iT,,. = i. 



for /,n, - -, 

(r = 3,4,5, ■■■). 
for An ^ 1, 



whence, for 

i = 0, the main lobe is l/T^ wide, and the equivalent width of Poi(/) is 

i/(2rj. 

i = 2, the main lobe is 2/T„ wide, and the equivalent width of P2i{f) is 

4/(33'™), 
i = 3, the main lobe is 2/T^ wide, and the equi^^alent width of Psiif) is 

L258/7'™ . 
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Fig, 10 — Approximation to standard spectral windows. 

For /i < i/Tm these equivalent widths are to be reduced. For /i = 0, 
they are to be halved. 
Assume, next, that 



Q,(/) ^.lU - (r„j)T, I/I ^i. 

J m 

= 0, otherwise, 



(B-8.7) 



which approximates Qi(/) quite well for i = 1, 2, and 3, aw is shown in 
Fig. 16. Let us further a.ssume that A ^ 1/T„, and that, at least for 

|/-/,| ^ i/r„,, 



PU) = P{h)[^ + ^TM - h)\. 

Then we can evahiate the etiuivalent width of 

Pa(0 - Hi{j;h)P{i) 
by sini])le integrations, finding 



(B-8.8) 



429 



3.50 T, 



Since /3^ cannot exceed 1, we have 



•(■ - s) ■ 



U5 L23 



(B-8.n) 
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showing how Httle effect a Imear slope of P{j) across the main lobe of 
■^t(/; /i) has on Wc , even when /? is large enough for P{f) to vanish at 
one edge. 

If P(J) has exactly the same form as the Hi{f; /i) corresponding to 
(B-8.7), then 

W,^'^, (B-8.10) 



a rather smaller value. 

If, on the other hand, we take 



T„ 



a^t 1 



(hif) - A[i- {T,.jyy, \f\^ir> ,„ , 

T^ (B-8.U) 



= 0, otherwise, 
then for C = 2, and P{f) given by (B-8.8), 

7 



TI^. - 



5^(l+fl)' 



so that 



while for C = }, 



so that 



^^< in ^ ^, (B-8.12) 



We = 



3T, 



(-?)■ 



In general, we can use 



k^ < W. < 1-^ . (B 8.13) 



W.^~ (B-8.14) 



as a conservative approximation which provides a factor of safety often 
near 1.15 or 1.20. 

All this was for/i ^ l/T^ ■ As/i is reduced below l/T,^ there is over- 
lapping between Qi(f — /i) and Q;(/ + /i) in Hi{f;fi). Asa consequence, 
the equivalent width decreases in a way which is not worth examining in 
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gretit detail. (At/i = 1/(27' „,) the equivalent width has decreased about 
15 per cent, and at/i = it has fallen to just half its usual value.) 

B.9 Equioalent Degrees of Freedom 

Let us assume that P{/) is flat — uniformly equal to p^ . Then the 
power variance spectrum r(/) will also be flat, but with a value of 
2pQ~/T'„ . Let us consider //,(/; .A) to be the ideal bandpass power transfer 
function 

Hi{f;fd --4, /i--^< I/I </. + y. 

^ 0, othermse, 

where/, > 1172, although such a transfer fmiction is not even approxi- 
mately realizable under the requirement that Diir) ^ for j t 1 > T„. . 
Then 

avc{P,(/i)} - AWv.> 

and 

A'Wp,' 



yar {P.ifi)] - 



'K 



If we e(iuat(! Ibese moments with the correspond in g moments of a mul- 
tiple of a (■lii-s<iuare variatc with k degrees of freedom, wc get 

, 2[a ve iP.(/i)il- _ .,„..,/ 

'^- var{P.(/Or"-" "■ 
We get the same result if Hi(f; /i) is assumed to be the ideal lowpass 
power transfer function 

//.(/; /i) = A, I/I <ir, 

^ 0, otherwise. 

In either ease we get only one degree of freedom when IT = l/{27'„) . 

This suggests that the frequency range / > be divided into dcmcn- 
iary hamh of width 

A/ - ^^ (B-0.1) 

\\\\\\ oiif iJcqnr. of Jirvdomin each. {In the presence of very sliarp iieaks 
in the original spectrum it would l)e somewhat more accurate to di^-ide 
the freciuoncy range — ^ < / < <^ in^o bands of widtli l/T^ with one 
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degree of freedom in each, and with one band centered at / = 0.) It 
follows from the results of the preceding section that, if P(/) is reasonably 
smooth, we may regard the stability of the power density estimate 
Piifi), for i = 1, 2, or 3, as approximately equal to that of a chi-square 
variate with k degrees of freedom, where 

for one piece (or record) . 

B.io Filtering and Analog Computation 

Power spectiimi analysis from continuous data is frequently done by 
filtering techniques. In this section we mil examme some of these tech- 
niques. In particular, we will try to express their results in such a form 
that we are led to express their reliability in equivalent numbers of de- 
grees of freedom. 

A common technique is to apply the signal to a narrow-band filter, 
allow some time for initial transients to become negligible, and then 
measure the average output power over the remaining time of the record. 
This corresponds to Mode I as described m Section 10 of Part I. In this 
technique it is clear that the estimate Pr(fi) of the power density P(/i) in 
the power .spectrum P{f) of the original random process at the filter in- 
put, is, substantially, 

Py{fd - [ Pou..(/;/i)-rf/ 

J—ra 

where 

Pouta;/.)- iF(/;/or-p(/) 

is the power spectrum of the modified random process at tlie filter out- 
put, and Y{f; /i) is the transfer function of the filter with a narrow pass- 
band around the frequency fi . The record length is shorter for the 
modified process than for the original process, by the time allowed for 
the initial transients to become negligible (at least the reciprocal of the 
bandwidth in cycles) . The effective record length for the modified proce,ss 
determines the width of the elementary bands, and the equivalent num- 
ber of degrees of freedom is the number of elementary bands in the 
equivalent width of Pout(/; /i), or the equivalent width of | Y{f; fi) f if 
P(/) is reasonably constant in the filter pa.ssband. 

In the technique described as Mode II in Section 10 we integrate all 
of the power output of the filter, and divide by the length T of the origi- 
nal record to obtain the estimate Pr(/i)- The result may clearly be ex- 



MKASUREMENT Of POWER SPECTILV 517 

pressed in the form 

Py(/i) = \, £ !ll'{^;/i) * [B(t)-Xil)]]'dl, 

where W{t; /i) is the impulse response of the filter, and B(t) = for 
/ < and / > T, but is otherwise arbitrary. To reduce this to a famihar 
form we fir«t write it out in detail as 

go 

Pvifi) - y, /// lK{n ; /i) ■ TF(t, ; f,)-Bit - n) -Bit - r.) -Xit - r.) 

•X(t — T->) -dndT-idt, 
so that 

ave {Fr(/i) ! - ^ /// ^y(r, ; /i) ■IF(t. ; fd-B{t - r,)-B{i - r,) 

• C(ri — Tz) -dri dT2 dt. 
Now, 

dry- T,) = r P{f)-e~^''^'^--'df, 

J QO 

while, if J{f) is the Fourier transform of B{t), 

f Bit - Ti)-Bit ~ T2)dt 
J—ao 

= fif Jif) .,/(/).,.-'<'-.) + -"('-.■ ,JJ' ,lf ^l 

—00 
CO 

= // JU'):IU")-^U' + /'0-e-''"'-^'-"^=' dj' dj" 

J— to 

Hence, 

ave SPv(/i)l = }j,j(lf\J{nf-mry;fd-W(r,;f,)-P(J} 

— 00 
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Further, since F{/;/i) is the Fourier transform of W{t;fi), 

a.vejP,(/,)} - ^ // I J(f') r-1 Y(f - J'-U) r-P(/) -dS' df. 

— DO 

Finally, therefore, 

ave{Pv(,A)} = [ rMf-Ji)-P(f)-df, (B-10.1) 



where 



HrU-J^) - I i -/(/) I' * i y{/;/i) r. (B-10.2) 



Since (B-10.1) is in the same form as (B-4.5), we may now apply the re- 
sultK of Sections B.8 and B.9. In particular, if P{/) is reasonably 
smooth, we may regard the stabihty of the estimate Py(fi) as approxi- 
mately equal to that of a chi-square variate with k degrees of freedom, 
where 



k = 2T 



j^l lMf;h)-df 



( [Hy(f-jOf-df 

Jo 



(B-10.:3) 



From the fact that flrif', /O is tlio cnnvolution of the power transfer 
function of the filter with (2/T)\ J{f) \~ it is clear that the passband of 
Hyififi) is at least as wide as that of the wider of the filter and 
(2/7') ] ./(/) I'. Hence, the resolving power of the filter method of power 
spectrum analysis is limited by the length T of available data, just as is 
that of any other method. If the filter passband is made narrower than 
l/T, say, not only do we gain very little in resolving power, but the 
stability of our power density estimates is then, at best, approximately 
that of a chi-square variate with only one or two degrees of freedom. To 
obtain a reasonable degree of stability the filter passband should be 
several to many times l/T wide. The i-esolving power then depends 
largely on this width. Under these circumstances it should not make 
much difference which of the four modes descril)ed in Section 10 is used. 

In Mode III, the output power may clearly Ik^ expressed in the form 

Py(f>) = l^ iyi'^(0-{W(t;f,) *[B(l)-Xmf dt, 
where B(t) ^ for ^ < and t > T, but is arbitrary otherwise. The re- 



MEASUREMENT OF POWER SPECTRA 519 

duction of this to a fiimilinr form follows closely that of the precedmg 
ease. The final result is that 

ave {I\{f,)] = r Hy(f;f,)-P(f)-df, (B-10.4) 

Jo 

where 

J J— M J— CO 



■Kf -n-df 



(B-10.5) 



■df. 



The analysis of Mode IV differs from that of Mode III only in the 
specifications of J(/). Indeed, the results for Modes I and II are also 
special cases of the result for Mode III. Mode II corresponds to J{f) = 
5(/), while Mode I corresponds to J(J) = 5(/) as well as 70*) = 5(/). 

It was noted in Section 10 that the zero of the input noise may not be 
qviite at ground potential in Fig. 5. The discrepancy may be considered 
to produce a spurious Ime or delta component at zero frequency in the 
spectrum of the input noise. It will have no effect on the average output 
power in Mode I if /i ^ 0, because the spectral window, which is simply 
I Y(f; /]) f is opaque at zero frequency. In Mode II, however, the spec- 
tral window specified by {B-10.2) may not be sufficiently opaque at 
zero frequency. The effect on the average output power depends upon 
the value of Hy{0; fx). If the .spectral window Hy{f; /,) were ideal in 
the sense that it has no side lobes, there would be no effect on the 
average output power for values of /i at least half of the width of the 
spectral window. This indicates the desirability of using a graded data 
wiudow B{t) in order to reduce the side lobes in the spectral window 
HviJ] /i), that is, essentially the side lobes in (2/7') !./(/) f. Since the 
latter window^ is necessarily positive for all values of /, reduction of side 
lobes here is not quite as easy as it is in the indirect computation tech- 
nique described in Section B.4, where selection can be exercised di- 
rectly on the lag window, and the spectral window can be negative at 
some frequencies. 

Another filter technique frequently used in power spectnnn analysis is 
to apply the availaljle record to the filter as a periodic function with a 
period equal to the length of the record. If a data window is used, so 
that the periodic function applied to the filter is of the form B{t)-X{t) 
in the interval < i < T, then the power spectrum of the input function 
is a line spectrum with power concentrated at integral multiples of l/T 
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cps. The total power in this spectrum, expressed in a form which displays 
the distribution in frequency, is 

input power = -^ Z)^ Pin ( |j , 
where, essentially, 

-I 1 •'—CO I 

Hence, the output power of the filter, is 



Pr(f{) = yL 



ik(i^^')r-(i)- 



Aside from the fact that we are now dealing with sums instead of in- 
tegrals, this aiialysis parallels very closely oiu' analysis of Mode II. It 
should be noted, ho\\^ever, that while our siunmands are even finictions 
of q we may not run our sums from q ^ to g = t», and then double 
the result, unless we take only half of the first (q = 0) term. Hence, with 
this technique the equivalent number of degrees of freedom should be 
taken as 



/,■ - 



_g=— 00 



5=a> I /„ \ |2-)2 



q^fXJ 



(--/.) f 



Yll 



pro\'ided that this turns out to give k > 3 or 4, say. It is easily seen that 
this formula discourages the use of this technique with a filter whose pass- 
band is only a few times 1/T wide. 

B.ii Prewhitening 

The techniques required here are standard in communication engi- 
neering and do not require specific treatment. As these techniques are 
ordinarily used, the orighial stationary random proce.ss is in effect con- 
tinuously acting on the input end of the prewhitening filter, so that the 
output of the filter may be regarded as another stationary random 
process for purposes of spectral analysis. If these techniques are used 
where it is practical to obtam only a finite length of the origmal process 
to apply to the input of the filter, we must discard an initial portion of 
the output, corresponding to the time required for the filter transients 
to die out, as well as all of the output after the input has ceased. These 
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considenitions iiie tEikcn up in greater detail in Sections B.15 and 16 in 
connection with the analysis of equi-spaced discrete data. 

Details for Equi-Spaced Analysis 

B.12 Aliasing 

I^t us consider a stationary random process whose autoco\'ariancc 
function C'(t), and power spectrum P{f) are known exactly. If we now 
take only the values of C{t) at uniformly spaced values of t, viz. 

T - 0, ±Ar, ±2At, ■■• 

we can, in principle, calculate a correspondmg (ahascd) power spectrum 
Pa(f), by using the formula 

J— 00 

where V(t; At) is an infinite Dirac comb as defined in Section A.2. 
Making use of the results of Sections A.2 and A.3 we have 

P.U) = A (/; i) * P{f), 

or, explicitly, 

Thus, if it happens that F(/) is zero for | / ] > 1/(2 At), as illustrated in 
Fig. 17(a), there will be no overlapping of the individual terms in Pa{f), 
and the result of the summation will be as illustrated in Fig. 17(b). In 
this case, we can restore Ihe original spectrum by multiplying P„(/) l)y 
a i-ectjingular function according to the formula 

P(S) -PA!) - S(f)-PM), 

where 

1 



SU) - 1, 1/1 <: 



= 0, 1/1 > 



2At 

1 
2At 



for, in the absence of such overlapping, P. (/) = PU) for 1/ | < 1/(2At). 
Hence, we will recover the original autocovariance function C{t) from 
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that for the discrete scries by a convolution according to the formula 
G{t) = G(t)*[V(t; Ar).C(r)] 

= At- J2 G(t ~ qAT)-C{qAT), 



wlierc 



81 n 



G{r) ^ 



At 1 yr r 

— - — ■ dif — 

r At At 



Now let us eousider a second stationary random process whose auto- 
covariance function C(t) happens to be related to C(t) by 

C{r) ^G{t)-C{t), 

where 6'(t) is unity at t - 0, ±At, ±2At, etc. Since 

V(t;At)-C(t) = V(r; AT)-C(r}, 
it is clear that Pa(f) will be quantitatively, and in the utmost detail 

(a) P(f) AND P.(f) AND R,(f) 



-fN 



(b) Paif] AND Pa(f) 





1 — -f 

If 7 



PRINCIPAL 
' ALIASES 



fN 



Ar 



(c) p(f) 




Fig. 17 — Effect of sampling on power spectra. 
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idciitjciil Willi r\(f). Hence, the principal pari P.,(/) of the ahased spen- 
tniin /\(/), that is, the part in the range |/] < ]/(2A7), will not in 
general be the power spertrum of the second process. In fai^t, if *S'(/) ^^ +11*5 
I'ourier transform of G{t), the power spectrum of the .second process is 
related to the power spectrum of the first process by 

P(I) = s{f) * PU)- 

In general, this spectmm covers an infinite range of frequencies, so that 
the aliased spectrum 

will involve overlapping of the mdividual terms. This overlapping will 
account for the quantitative identity of Po(/) vnth P^if), and the failure 
of its principal part PaU) to represent Pif) even in the range |/| < 
1/(2 At). Fig. 17(c) illustrates such a P(f). 

It may well have already occurred to readers familiar with amplitude 
modulation that using only uniformly spaced values of C(t), viz., 
C(/-Ar) where r ^ 0, ±1, ±2, ■ ■ ■ , has the same effect on the power 
spectrum as the simultaneous amplitude modulation of carrier waves 
with frequencies q/Ar where 5 = 0, ±1, ±2, ■ ■ - . If the two-sided power 
spectrum P{f) corresponding to C{t) is visualized as side-bands on a 
zero-fre(iuency carrier, then the aliased spectrum Paif) correspondhig to 
C(rAT) will be naturally visuahzed as the same sidebands on carrier 
frequencies q/At, where q ^ 0, ±1, ±2, • ■ ■ . If each sideband of P{f) 
does not extend beyond the frequency l/(2Ar), then there will be no 
overlapping of side-bands in Pa{f), and the principal part P.iif) of P^if) 
will be identical to P{f). Contrariwise, if each sideband of P{f) extends 
beyond the frequency l/(2AT),then there will be overlapping of side- 
bands in P„(f), and the principal part PaU) of P„if) will not be identical 
to /"*(/). In any caise, however, it is important to note that 

PAf)<U- PADdj-l PA{J)dJ=\ Pif) 'If. 

-l/{2iT) ■'-1/(2 At I J-co J-'B 

If we examine the relation of PhCD to 7^(/), where 



g/'^.yV' -^"^i •^-*'' 



we find that 



'■<<-f''-''(-^') + 5[K^-^') + Ks+^')]' 
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ffj 

COMPLETELY FOLDED 



Fig. 18 — Spectrum folding, 

(the right-hand side representing PM') for all /')■ We say, therefore, 
that the power density at / = (g/Ar) — f and at / = (g/Ar) + /' hi 
the true spectrum P(f), where g ^ 1, 2, ■ ■ ■ , co, are aliased at /' m the 
principal part P^(/') of the aliased spectrum. Clearly, the presence of 
aliases in power density estimates from time series is a matter of some 
concern. 

Aliasing is sometimes called spectrum folding, because the pattern by 
which various frequencies are aliased with one another corresponds to the 
result of folding up the frequency axis, as illustrated in Fig. 18. The 
fre<|uen('y of the first fold is called the Jolding or Nyquist frequency. In 
the discussion above this was /* = 1/(2At), which usually coincides 
with/jv = l/(2At). 

B.13 Transformation and Windows 

A general outline of a hypothetical procedure for power spectrum 
estimation from a imiformly spaced discrete time series of finite length, 
by the indirect route, is as follows: 

(I) Let X(, , Xi , • ■ • , X„ be the time series and let At be the time 
interval between adjacent values. Compute mean lagged 'products, with 
lag interval At = hAt, accordmg to the formula 



Cr - 



1 



n — hr 0=0 



r ^ 0, 1, ■ • ■ ,m. 



where m. ^ ^ 



)■ 
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(In a practical procedure, this formula will have to be modified to avoid 
difficulties with spurious low-frequency components.) 

(2) Compute raw spectral density estimates according to the formula 



Vr = At- 



g=m— 1 ~| 

Co + 2 y; C5-cos^+ C„,-cosr7r . 



Since Vr is symmetric in r about every mtegral multiple of m, it is neces- 
sary to compute it only for r ^ 0, 1, • • ■ , m. The frequency correspond- 
ing to r is r/(2mAT), as shown below. 

(3) Compute rcjincd spectral density estimates according to the formula 

Ur = a^oVr + E a,i[Vr+J + K-;l , 
HI 

where the a's are the same as m Section B.5. In particular, for the 
third pair of lag and spectral mndows described in Section B.5, we 
have flso = 0.54 and asi = 0.23, all others being zero, so that 

Ur = 0.23 Vr-i + 0.5-t Vr + 0.23 n+i ■ 

(Those power density estimates should of course be doubled if they are 
to be referred to positive frequencies only. This doubling may in fact be 
introduced through the mean lagged products.) 

Comparing this outline with the one for the continuous case (Section 
B.4), it will be noted that the window is introduced by different methods. 
In the continuous case the window is introduced as a lag window before 
co.sinc transformation, in order to avoid convolution after transforma- 
tion. In the discrete series case, since convolution is not difficult, indeed 
is very simple, convolution after transformation is convenient, and the 
lag window is shaped after the cosine transformation. 

To relate the outlined procedure for the discrete series case to that 
for the continuous case, we note that 

ave {C\\ - C(rAT), 

where C{t) is the tmc autocovariance function. Hence, 

C(0) + 2 S CiqAr) cos ^ + CimAr) cos rx . 

This may be expressed in the form of a Fourier transform, viz., 

ave [VM - ( W„Xr; At) ■C(T)]-e-'''' dr, 

J— 00 
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where V,„(t; At) is the finite Dirac comb defined in Section A.2, and 



/ = ^- '■ 



_/=r/{2m.AT) 



2ir 2mAr ' 
Therefore) 

ave(7.) - rQo(/;AT) * F(f) 

where P(f) is the true power spectrum. Hence, Vr may be regarded as an 
estimate of an average-over-frequcncy of P(f) in the aliased neighbor- 
hood of / = r/(2mAr), with the spectral window Ooa(/) = Qnif; At) 
ilhistrated in Fig. 9. 

Three other \'iows of the relation of Vr to P(f) may i>e developed from 
the fact that (from the end of Section A.2) 

V,„{t; At) = Do{r)-Hr;Ar), 
(Mf;Ar) = (Uf) *A (./"i^), 
whence, 

ave {Vr\ - rQo(/) * A (/; 1) * /^{/)1 

[_ \ At/ Jf-r/i2m-AT) 

The view taken in the preceding paragraph corresponds to the substitu- 
tion 

(Ml) *'4(/;^)^ (h-.i.n- 
A second view corresponds to the substitution 

A(^f;j^*P(f) = P.(f), 
and a third to the identity 

The latter two correspond to the results 

.iYe{K.j =\(Mf)*PM)] 

avcM^i =\QcAf)*PA{f)] 
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Hence, Vr may also be regarded as an estimate of an average-over-fre- 
quency of the entire aliased power spectrum Paif) in the neighborhood of 
/ = 7'/(2mA7), with the spectral window Qa{f) illustrated in Fig. 14, 
or, and usually most usefully, as an estimate of an average-over-fre- 
quency of the principal part PaH) of the aliased spectrum, in the neighbor- 
hood of / = r/(2mAT), with the aliased wmdow QoaU), which is illus- 
trated in Fig. 9. 

Finally, a fourth view corresponds to the substitution (from Section 
B.4) 

^o(/)*^(.f) -ave[n(/)|. 

Hence, Vr may also be regarded as an aliased version of the estimated 
power spectrum Po(/) which \\-ould have been obtained from the con- 
tinuous data in accordance vntk the hypothetical procedure outlined in 
Section B.4. 

Regarded from any one of the four points of view developed above, 
we see that the raw spectral density estimates Vr , (assuming At suffi- 
ciently small, so that aliasing is negligible) are in the same position as 
the estimated power spectrum Poif) in the continuous ease; the spectral 
window QoA(f) is essentially Qo(/) with the same undesirable side lobes. 
Hence, the raw power density estimates must be refined. As in the con- 
tinuous case, the refinement can be done by using a graded lag window 
before transformation. In the discrete series case, it may also be done by 
convolving the raw estimates with the ai/s of Section B.5 to obtain the 
refined estimates, as described under (3) m the outline. 

In any event, we may write, as we did at the end of Section 4, of Part I, 

where 

Hlf;h) - (?.</ + /O + 0.(/-/i). 
Alternatively, we may write 

or, more usually, 
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where 



and 
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Fig. 19 — Aliased spectral window Qsa for ?n — 12. 



HuifJi) = Qui! + /i) + QiM - /i) , 



In particular, Qa^(f) and Qaa{J) are illustrated in Figs. 8 and 19. 

B.14 Variahiliiy and Covariahility 

The analysis of variability of power density estimates from discrete 
time series is a repetition of Section B.6 up to and including (B-6.4) 
for GOV [Mih , Ti), M{h , Ta)) . Beyond this point we now have to deal 
with summations rather than integrations with respect to k and ^2 .. 

If the range of summation in the formula for the mean lagged products, 
viz., n-hr, is replaced by an average range n' , which may be regarded as 
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the effective length of the series, and which may usually be taken as 

n = largest integer less than ( n — — - J 
then 

cov{Cr,C\] = I COS oir At ■ COS i>)S^T ■ T Mif) ■ df, 
where 

r.,(/) = 4 (' p(f + n-pu - f) ■ i^^^y-df 

J-ao \n sni u M/ 

(reducing to (B-G.IO) and (B-6.11) as At ^ with n'At = TL). Finally, 
if Vr and LK are refined power density estimates based on applying the 
spectral windows Qi{J) and Qj{f), respectively, to the aliased power 
spectrum PqC), then 

oov Kv.f/.l --;/>...(/; 2^jH.(/;^-^J.r.,(/)../. 

In particular, of course 

We see now that there is essentially no difference between power 
density estimation from imiformly spaced time series and power density 
estimation from continuous data, except for aliasing and its secondary 
consequences. In particular, if P{f) is reasonably smooth, and if aliasing 
is neghgible, then we may judge the stability of the power density esti- 
mates Ur for the uniformly spaced case by analogy with a chi-square 
variate with k degrees of freedom, where 

"-'{^r-i)- -l.V-,(™-l). 
= half as much for r = 0, m. 

B.15 AND 10 Transversal Filtering* 

If the Z's are moving linear combinations of the X's, for example 

Z5 = caXg + CiXg_i + ■ • ■ + CkXq_k , 



* Sec Kallmann^- for the origin of this term. 
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and we take At = I for convenience, then the spectra are related by 

Pzif) = Px(f) I Co + c,€^'" + c.e-'''' + ■ ■ ■ + c.e-'"' f 

- PxiMci + c{ + c.' + ■ ■ ■ + o') 

+ 2(coCi + C1C2 + • ■ ■ + Ck-ict) cos w 

+ 2(coC2 + C1C3 + • • ■ + Ck-2Ck) cos 2w + • ■ ■ 

+ 2{coCk) cos /coj], 

where oj = 2irf. The first equality arises by considering Xg = e'^*", and 
the second involves the sequence of coefficients 

h_ic ^ C()Ca- , 

b-k+i = CoCk~i + CiCk , 



?)_1 = CoCi + C1C2 + ■ ■ • + Ct^iCt , 

(>0 ^ Cii^ + Ci" + • ■ ■ + Ck", 

bi = ciCo + c-f-i + ■ ■ ■ + Ca-ca--! , 

^2 — C2C0 + C-jCi + ■ • • + Cl;Ck--2 , 



bk^i ^ Ck-iCu + CkCi , 

bk ^ CkCo, 

which represent the convolution of the se(iuencc Cu , Ci , ■ ■ ■ , Ck with 
itself. 

As a filter, the moving linear combination is characterized by 

I Y(f)f = &o + 2 61 cos a; + 2 62 cos 2w + ■ ■ ■ +2 h cos koi, 

which is never negative (as the square of an absolute value). Since we 
can write cos ju as a polynomial in cos w of degree j, we know that : 

(1) I Y(f) \^ can be written as a polynomial of degree k in cos w, 

(2) for — 1 g cos w ^ 1 , it is not negative. 

Any such polynomial can be realized as a moving linear combination 
(in several ways, see Wold'^''). The simplest way to see this is to factor 
the given polynomial into linear and quadratic factors. By appropriate 



MEASUREMENT OF POWER SPECTRA 531 

choice of signs these factors will satisfy (2), and, if each corresponds to a 
real niovinji; linear combination, the moving hnear (U)mbination ol>tained 
hj' applying them successively will correspond to the given polynomial. 
Any such hnear factor tukew the form 

! Yiif) p = -4'(l + acoso)) 

with I a I ^ 1, which may be reahzed by k ^ 1 and 

Co , ci = 1^4 (Vl + a ± Vl - a)- 
Any Huch f]iiadratic factor takes the form 

I 5'j(/) \' = -'I (1 + «1 cos W + Q2 ('OS to). 

The condition for this to be non-negative for | (^os w ] ^ 1 is 

I «i I ^ 1 + tta, 

and if a2 ^ 1, so that the first condition forties an internal extremum 
on [—1, +1], we must also have ai" ^ 4a2 . We may write 

I Yj (/) r - A' M + ^ + ai cos w + ^ cos 2a; j , 

whi(^h is realized bj' a three-point moving hnear combination with 

j\ _. 

Co,C2 = .7—7^ (Vl + aa + V ± Vl - fli! + V ) > 

ci = ^ (Vl + fla + fli - Vl + a2 - fli) , 

the conditions stated above ensuring that aU radicals are real. 

These two cases — linear and quadratic factors — not only prove 
that every polynomial non-negative on (~1, +1) can be obtained, but 
provide at least one way to find a moving linear combination with an 
assigned polynomial. 

One special case deserves record. If we require a simple moving linear 
combination with F(/u) = 0, we may use 

1 

2 COS wo 
Ci = -1, 

1 



Ci = 



2 cos Wo' 
which has | Y(f) j' ^ [1 — (cos w/cos wo)]'. 
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Now that methods are available for findmg moving linear combina- 
tioiiH whose spectral windows are prescribed polynomials in cos w, some 
attention should be given to approximating an arbitrary desired response 
by polynomials. If a roughly "eqnal ripple" approximation (where the 
local maxima deviations of approximation from desired are roughly 
equal) is desired, then the techniques described in the next paragraph 
will be quite effective. If, as seems hkely, however, we desire the frac- 
tional error 

approximation — desired 
desired 

to have roughly equal ripples, then no specific method seems to be avail- 
able. All we can suggest is the following procedure: (i) find a roughly 
equal ripple approximation, (ii) find the zeros of its error, (iii) squeeze 
these zeros together where smaller ripples are desired, and open them 
out where larger ripples can be permitted, keeping as much of the same 
general pattern of distances between zeros as possible, (iv) construct 
a new polynomial with these points for the zeros of its error, (v) adjust 
the result slightly, if necessary, to make it non-negative. (This proce- 
dure sounds quite plausible, but the reader should be warned that we do 
not know how to be more specific about "keeping as much of the same 
general pattern of distances as possible". However, we expect the pro- 
cedure to work in many hands.) 

The construction of the roughly "equal ripple" approximation can 
proceed in many ways. In almost every case, one should begin by calcu- 
lating values of the desired response at values of cos w equally spaced 
from cos o) = -|-1 to cos w - - 1. The semi-classical approach (DeLury,^^ 
Fisher-Yates, 3^ or Milne^^) would be to fit orthogonal polynomials to 
these equi-spaced points. The results would be least-square fits, but 
might be far from equal-ripple. The process of "economization" (Lanc- 
zos," Lanczos,^^ streamlined by Minnick^^) will allow us to take an 
over-fitted least-square fit and back up to an "equal-ripple" polynomial 
of lower order. However, the direct attack, based on central differences 
of the desired response (at equi'-spaced values of cos to) as proposed by 
Miller*" seems likely to be shorter, even allowing for the expansion of 
the Cebysev or Chebyshev polynomial series into single polynomials. 

One further set of considerations remains which is sometimes impor- 
tant. These relate to the starting up of a moving linear combination. 
If Zq involves X^ back to X^^u , then there will be k less Z's than X's, 
and nothing can be done about this. Any transversal filtration causes the 
loss of some data, and if the filter characteristic is complicated (as a 
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polynomiul in cos w) the loss will have to be correspond mgly great. This 
is usually iminiiJortant, but, with very short pieces of record, might be- 
come crucial. 

In Section li5 we remarked that an autoregrcssive relation, e.g., 

between X's and Z's enabled us to obtain the reciprocal of any suitably 
non-negative cosine polynomial as the ratio of the spectrum of Z to the 
spe(!trnm of A'. There arc different ways of looking at the situation which 
make this statement true, not true, or partly true. If we have all the A''s 
hack to q = — <», we can calculate the corresponding Z's and it is true. 
If we have only a finite number of X's, as always in practice, then we 
have to start the calculation up in some other way, perhaps like this 

A ^= CflZo , 

Xi = Ci,Zi + CiZii, 



X^^i = CdZk^i + CiZfr_2 + ■ ■ ■ + ca-]Zi) , 
A^A- = CiiZh- + CiZt-i + • ■ ■ + CkZo . 

As a consequence, we will have introduced an initial transient into the 
form of the autoregrcssive transformation so that our Z's arc never 
related to the X's in the way we supposed. In this sense the statement 
is untrue. In many cases, however, this initial transient dies out quite 
quickly, and if we discard enough initial Z's, perhaps 2/,- to 4/; of them, 
we can regard the reciprocal of the cosine polynomial as a satisfactory 
approximation. In this sense the statement is partly true. 

In tlieory, an autoregressive scheme corresponds to an infinitely long 
ino\-ing linear combination. In practice it corresponds to a sequence of 
changing moving linear combinations of finite but increasing lengtli 
which approximate the infinitely long one. Sometimes the approximation 
is quite good enough. {Perhaps the main ad\antage to the autoregressive 
scheme is its likely reduction in arithmetic — a few autoregres-sive coeffi- 
cients corresponding to a long moving linear combination.) 

B.17 Smoothing and Decimation Procedures 

We now study the effects of applying, successively and in any order, 
simple smoothing and decimation. The basic operations are taking 
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oqu.illy weighted means of (■ consecutive values, and discarding all l)Ut 
every ./tli value. Simple sums are usually more ('on\enient than means, 
and, since the results dilTer only by a fixe<l conwt^uit fac^tor, lead to the 
same spcc^tra except lor a constant. We define, then, as our basic opera- 
tions, St and Fj , where (for definitcness) 



means 



while 



means 



Y = S(X 
Yi = A'. + A'i+i + ■ - ■ + A'.-+,_i , {f- terms), 

Z = FjX 



Z^ — A^i+(i_i)j . 

It will also be eon\'enient in dealing wdth the algebra of these opera- 
tions, to use an operator for simple summing at wider spacings. Wc 
therefore define iS'/''' by taking 

W - Si^'^X 

to mean 

Wi = Xi + Xi+, + ■ ■ ■ + Xi+^t-m, (^ terms). 

It is immediately clear that 

St'^'S, - Sa (B-17.1) 

both sides corresponding to forming sums of th consecutive Xi's. 
Now, consider the equation 

Z = S,F,X, 

which means that if 

Y = FjX, 

then 

Z = ScY. 

These, in turn, mean that 

Yi = Xi_|.(i_i)j, 

and 

Z, ^ Yi + F,+i + ■ ■ ■ + r,+,_i . 
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Hence, 

'/ji = .Y„ + A^+z + • • ■ + Xfl+cf-Dj, 

where y = 1 + (i — i)j. Now, since 

means 

H'^o ^ A'c + A^H-i-j + ■ ■ • + A'(,4-(/_i)j, 
we ha^'c 

which corresponds to 

Z - i^.TF. 
Thus, we have shown that 

^',/'', = F.St'K (B-17.2) 

Similarly, we find that 

;,'/"F, = F,St'"\ (B-17.:j) 

The order in which V^ and 5( or S/''' are apphed is thus important. 
On the other hand, it is easy to show that 

&S>. = S,St ^ Sn., (B-17.4) 

and 

FjFk = F,Fj ^ Fj„. (B-17.5) 

Thus, sample reductions are 

S^FiSi = FiS,^'^Si = F4.Sa, 
and 

It may 1ki noted also that FiSi corresponds to "sununin}!; in (barely) 
non-overlapping l)lo('ks of f terms". 

A reason for these differing relations i-s easily found. The changes in 
the spectrum duo to aS, and Fj are quite different in character. ^S, multi- 
plies spectra l)y the power transfer function 



1 -he-''''" + ■■■ -\-er 



Sm — ;r- 



sm — 
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while (S/" multiplies spectra by 

sm--- 



hccAt 
sill — :t 



On the other hjuid, Fj changes the folding frequency, /a- , to a new value 
(1/^)*^ us large as before, namely 

Jn ^ fx/j , 

and aliases together the old principal aliases in sets of j. The j old prin- 
cipal aliases which have / as their new principal alias are 

/, 2/; - /, 2f'^ + /, 4/; - /, 4/^ + /, • - ■ (j terms). 

Our comliiiied operations wiU, in general, change both amplitudes 
and prini^pal aliases. If 

PUf) = T{f)P,(f) + T{2f', - f)PA2f'. - J) 

+ mf^ +/)/'-. (2/^+/) + ■■■ 

where Pj^a{j) is the new ahased spectrum, PaU) is the old aliased spec- 
tmm, /jv is the new I'olding (Nyquist) frequency, and the summation 
continues as long as the arguments lie below the old folding frequency, 
then we call 7'(/), for any / up to the old folding fre(|uency, the trans- 
mission. (If there is no new aliasing, the transmission is merely the 
power transfer function.) The ratio of transmission for a desired fre- 
quen(!y to the transmission for an undesired alias of that frequency, 
such as T(f)/T{2fN — f) for example, will be culled the protection ratio. 
Fig. 20 illustrates some simple cases. Curve (b) is the transmission of 
*^3 , ^2*^3 , or, indeed any FjS-i . All of these are given by 

sm -— 



o)At 



Scale (c) illustrates the reduced range of the principal aliases for F2 , 
FiSi , or, indeed any SjFzSk . Curve (d) shows the power transfer func- 
tion of S3 , regarded as following F2 . In terms of the respective folding 
frequencies, this curve duplicates curve (b). On an absolute frequency 
scale it is different. Curve (e) presents the transmission corresponding to 
S3F2 = F2Sa'^ which aliases into cun'e (d). 
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.PRINCIPAL ALIASES FOR {X} 

(a) ^—J M 



2At 



(b) 




^-PRINCIPAL ALIASES FOR F2 {X} 
A ^ 




sir 4At 




(e) 



Fig. 20— Transmifision curves for a simple example of smoothing and deci- 
mation. 

The transmission ( = power transfer function) of -S's is shown in Fig. 21 . 

The smoothing operation described in Section 17 was, in our pres- 
ent notation, FjS^- where ./ - Jc/-i, which equals SiF.Sj . In the case 
j = 2, we ha\e F-zSa = S^Fa^Sn , and the highUghts of transmission and 
folding pattern are as follows, where the frequency scale has been chosen 
to make the original folding frequency = 8. 



Original freq. 





1 


2 


3 


4 





G 


7 


8 


Aliased fre(i. 





1 


2 


3 


4 


3 


2 


1 





Transniission 


G4 


2(1 


zero 


3.2 


zero 


1.4 


zero 


I.U 


zero 



The protection provided for frequency 1 agauist aliasing from frequency 
7 is only in the ratio of 26 to 1. If the spectrum falls toward higher fre- 
fiuencies, this may be enough, but adequacy is far from certain. 

Double use of Ss before selecting every second observation would 
.scinare this protection ratio, giving a ratio near 700. If we are to sum 
by groups twice, however, we can do better than to use the same length 
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Fig. 21 — Transmission curves for Sa ■ 



of group twice. By using slightly different lengths, we cjin spread out the 
zeros of the transmission curve, and tend to hold the right-hand end of 
the transmission ciu've nearer the origin. Table V shows the transmission 
and folding behavior of FsSiS^ , with the original folding frequency 
taken as 18. Over the lower half of the folded spectmm, this choice 
yields protection (against aliasing) by a ratio of about 3,000, which 
should suffice under even moderately extreme circumstances. 

If we do not wish to fold quite so far (or in multiples of 2) then F-iS^Ss 
gives a protection ratio of 1,500 or better over the lower half of the 
folded spectrum. 
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Table V — Transmission and Folding Behavior of F-jSiSi 
OR F■.^S»S^ (Original Folding Frequency ^ 18) 



Original Frequency 


Foldfil ['requency 


Relative Transmission 








3136 


1 


1 


2356 


2 


2 


946 


3 


3 


156 


4 


4 


3.5 


5 


5 


0.03 


6 


6 


3.0 


7 


5 


7.4 


8 


4 


2.4 


9 


3 


zero 


10 


2 


0.04 


11 


1 


0.39 


12 





1.0 


13 


1 


0.17 


14 


2 


0.09 


15 


3 


0.06 


16 


4 


0.12 


17 


5 


0.28 


18 


6 


zero 



So long aswc are satisfied with such, only moderately large, protection 
ratios, and with a substantial fall-off of transmission over the useful part 
of the spectrum, sudi repeated umvcighkd .summing-or-averaginss by 
groups are likely to be most desirable from the point of \'iew of machine 

cmnputation. If re<iuirement.s on the smoothing-and-decimation opera- 
tion are more stringent, smoothing with a suitably cliosen wet of graded 
weights is likely to be required. 

B.18 Mothfied Pilot Estimation, Cascade Estimation. 

The addition-and-.subtraction calculation discussed in Section 18 
(i) yields only one estimate per octave, (ii) is imduly sensitive to trends, 
(iii) involves windows which are broad even for a one-per-octave spacing, 
and (iv) is dehl)ei-ately wasteful (jf data in the interest of computational 
simplicity. There may well he a desire to correct any or all of these. 

The h operator, in a notation extending that of the last section, takes 
the form 5 ^ FJ), where Fo is the operation of dropping every alternate 
value and D is the operation of differencing adjoining values. \Vc may 
rei)lace 5 liy 1) in the coniputing routine, keeping a the sam<', with the 
fr)llowing effects: (i) loss of synnnetry in the procedure, (ii) introduction 
of numerical factors like 8/15 (to be applied to the sums of scpiarcd 
differences), (iii) near doubling of nvunber of differences available for 



540 



THE BELL SYSTEM TECHNICAL JOURNAL, MARCH 1958 



squaring and summing. If not enough data is available to give adequate 
stability to the results of the standard pilot method, then this modifica- 
tion may be worth ^vhilo. 

If we denote the operation of omitting the other half of the values by 
Fi and introduce a' ^ F2S2 as well as o- = F2S2 , then, by using D, a and 
ff' siu^cessively, we may obtain even more differences for squaring and 
summing. Table VI shows a convenient pattern of computation, in 
which sums and differences are not located in lines near the lines from 
which they are derived. Table IX, below, (in Section B.28) provides 
a numerical example. 

Table VI — ■ Compact Calculation Arrangement for Complete 
Version op Pilot Estimation Procedure 



X 


DX 


iU^ 


^f.^'}^ 


{-■]{'.']- 


HM!:'l^ 


WAl'A'^ 


X, 


DXi 


sx, 


DSX, 


SSX^ 


DSSXi 


SSSXi 


x« 


DX^ 


SXi 


DSX, 


ssx^ 






X, 


DX, 


sx, 


DSX, 








X, 


DX, 


sx^ 




SSX3 






X, 


DX, 












Xt 


DX^ 


SX-i 


DSX2 


SS.Yo 






A', 


DXj 


SX4 


DSX, 








X, 




sx, 




SSXi 







Dji. g — -^ q+l — -^g I 

oAq = Aqu -f- A, , 
DSX, = (5X,^,) - (SX,) 



SSX, = (SXg^d + (SX,) 
DSSX, = (SSX,+,) - (SSX,) 
SSSX, = iSSX,+,) + iSSX,) 



Two methods are available to cope with trend difficulties. The original 
series may be differenced, and the difTcrent^ed series subjected to pilot 
estimation. (The mahi disadvantage being some loss iu accuracy, etc., 
at very low frequencies.) Or each column of differences may be "corrected 
for its mean" adjusting the corresponding divisor from fc to ^' — 1. (This 
is only recommended when the first modification is in use and the 
column contains all D'ti, not merely the corresponding 6's. Instead of 

'^ t (D,r 

J.k 1 
then, the corrected sum, corresponding to (/.; + ])/2 squares, becomes 
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111 \-ie\v of the fact that ^ Dq should e(iiial the last value m the preced- 
ing (column minus the first \'aluc there, a convenient check on the D,, 
exists. 

If, as may not l)e too nnhkely, none of these modifieatious suffices, 
as will surely be the case if more than one estimate per octave is required, 
something better than the modified pilot estimation method, without 
going all the way to the detailed method's equi-spacing in frequency, 
may l>e desired. Such an intermediate method should give roughly con- 
stant spacing on a logarithmic scale, and provide reasonably clean win- 
dows, with about a 100-to-l ratio between major lobes and minor lobes. 
It would be useful for high quality pilot estimation, and nught sometimes 
suffice for the complete analysis. 

Easy calculation and a roughly logarithmic scale both favor a cascade 
process, in each of whose cycles some computation is carried out on 
given values, and then half as many values are computed ready for the 
next cycle. We may expect, then, that it will bo possible to think of each 
cycle as having three phases: 

(a) computation of estimates 

(b) smoothing of given values 

((') deletion of alternate smoothed values. 
Our main attention needs to be given to the last two phases, since the 
first is a branch which can be changed rather freely. 

We are concerned, therefore, with smoothing procedures to precede 
halving of the folding frequency. We have, then, to choose two fre- 
quencies averaging to the new folding frequency such that we plan to 
make estimates based on the smoothed (and halved) values up to the 
lower of these, while effectively eliminating freciuencies above the higher. 
If the folding freriuency at the start of the present cycle is /o , these two 
frequencies can be written as a/o and (1 — a)Jn . In the next cycle, then, 
we anticipate estimation up to aja . In the present cycle, we anticipate 
estimation up to 'lafn and must consequently cover the octave from a/n 
to '2afu . 

In the choice of a we must balance two considerations of computing 
effort. ]''or a given number of lags (a given number of multiplications in 
forming niean lagged products per cycle) our estimates are spaced a fixed 
fraction of /u . The larger a and 2a/o , the more of these we may use. 
Contrariwise, the smaller a, the easier it is, in terms of computational 
effort, to provide smoothing which suppresses the whole interval from 
2a/o to /o by a factor of about 100 in comparison with what it does to 
any frequency between and a/o . 

Trial suggests that a \'alue of a near \ is reasonable. We msh, there- 
fore, a smoothing which suppresses frequencies between (f)/o and /o - 
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Two clemeutju-y smoothing^ with zeros iu this range are running ineans- 
or-sums of 2 (with a. zero at/o) and running means-or-sums of 3 (with a 
zero at (|)/o). If, for com-enience, we use sums, these operations multiply 
the spectrum by, respectively, 

2 + 2 cos 7r///o , 

and 

3 + 4 cos 7r///o + 2 cos 27r///o . 
If both are appUed, the factor takes on the following vahies: 



f/fo = 


0.0 0.3 i 0.5 0.6 


0.62 f 0.8 


0.82 ^ 


I 


factor = 


36 15 12 2 0.23 


0.08 0.146 


0.147 0.143 






The result is a protective factor (against the effects of aliasing on halving) 
of just over 100 for a = 0.3 and of about 80 for a = I. This should be 
entirely satisfactory for most pilot purposes. (If further protection is 
needed, Z^ ^ O.OX^-i + X^ + 0.6-Yg+i , which has zero transmission at 
f/fa = 0.815, could also be applied.) 

If we wish to reduce the number of additions, we might smooth Ijy 
threes, and then combine smoothing by twos and halving, e.g., 

Xg* — Xg-l + Xq + A g+1 , 

which requires 2.5 additions per Z-value. If we rearrange, however, to 

Xlq ~ X<lq + A2q+: , 
2A2g ^ X'iq "T" Xig } 

Zq = X2o_l + 2X'2q + -^29+2 j 

we find only 2 additions per X-value. Thus this type of smoothing and 
halving is computationally quite simple. 

If we use this .smoothing-and -halving process cycle after cycle we 
must, after obtaining our spectral estimates for the series actually proc- 
essed in a given cycle, adjust them for the effects of all the smoothings 
in preceeding cycles. Near zero freciuency this factor is (36) ' for d 
previous smoothings. At a few .selected frequencies the factors are as 
follows: 



///o = 


0.075 


0.15 


0.225 


0.30 


j - i (36)"^ 


1.05(36)"' 


1.23(36)"' 


1.60(36)"' 


2.4(30)"' 


j = 2 (30) ' 


1.06(36)'' 


1.29(36)"' 


1.81(36)"' 


2.95(36)"^ 


j = 3 (36)"^ 


1.07(36)"' 


1.31(36)"' 


1.86(36)"' 


3.10(36)"^ 


j=4 (36)"^ 


1.07(36)"' 


1.31(36)"' 


1.87(36)"' 


3.16(36)"' 
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Fig. 22 — Windows for m = 12, and smoothing from previous cycles. 

When an ordinary calculation with m = 12, for example, and banning 
is iisod at each cycle, the spectral windows of the more relevant esti- 
mates and the effect of smoothing in previous cyt'les appear as in Fig. 22. 
Clearly the estimates for r = 3, 4, 5 and probably 6 will be quite usable. 
The estimate for r = 7 may well be usable, but its mndow extends up 
to a point where protection against aliasing is beginning to be much 
reduced. Computation for all r from to 12 is probably worthwhile, 
lower \'alues of r providing rough checks for later cycles and higher 
values indicating the extent of the danger from aliasing (to estimates of 
the next cycle) during the smooth-and-halve phase of the present cycle. 

The resulting spectral windows are shown for parts of 4 cycles in Fig. 



/// r"/ 



23. The windows 6, 5, 4, 3 ~ 0', 5', 4', 3' — 6", 5", 4", 3" -' 6 
4'", 3'", and so forth, will give a fairly effective set of coarsely spaced spec- 
tral estimates. 

BJ9 Rejection Near Zero Frequency 

We come now to the details of compensation, on the average, for non- 
zero but constant a\-erage.s or for averages changing linearly with time. 
(As a convenient shorthand we will refer to these as "con.stant" and 
"linear" trends.) The A'';, , on a sample of which our calculations are to 
be I>ased, can each usefully be regarded as a sum of two terms: (i) a fixed 
(!)ut unknown) Irend and (ii) a sample from a stationary ensemble with 
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average zero. These terms are added together and are statistically inde- 
pendent (since one is fixed). 




3" 4" 5" 6" 




/ M \/ \t \l " 

hhhhh 

V V v \ 




FOLDING 
FREQUENCY 



FOLDING 
FREQUENCY 

Fig. 23 — Spectral windows in successive cycles (smoothing corrected for). 

Consider any quadratic expression in the Xi, . If we introduce the two 
terms for each A'^ , we may write the quadratic expression as a sum of 
thi'ee parts: (i) a quadratic in the trend (fixed, of course), (ii) an ex- 
pression linear both in the trend and in the stationary fluctuations (and 
hence of average value zero), and (iii) a quadratic in the stationary 
fluctuations. The first and last of these three parts are, of course, just 
what would have arisen had the trend alone or, respectively, the fluctua- 
tions alone been present. Hence, since the average value of the middle 
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part vanishes, the average value of the whole quadratic is the sum of 
the average value for the trend alone and the average value for the 
fluftuations alone. To study the efficacy with which a quadratic ex- 
pression rejects a trend in the presence of fluctuation, wc hare only to 
study Us behavior in the presence of trend alone. After this, we shall 
want to study the liehavior for fluctuations alone of those expressions 
which satisfactorily reject trend. 

(The variance of the quadratic expression will be determined from the 
middle and last parts. If third moments of the fluctuations vanish, as 
will be the case for Gaussian ensembles, the contributions will come from 
these parts separately, the covariance between parts vanishing.) 

A few formulas will be useful in discussing possible rejection tech- 
niques. These are conveniently derived on the basis oi n = 2k -\- I 
available equi-spaced values extending from —k through to +A;. (The 
indexuig of the values is only a convenience, and cannot affect any 
essential result. The limitation to an odd number of points is essentially 
a convenience also — ■ we shall replace 2A; + 1 by an unrestricted n rather 
freely.) 

The first formulas relate to constants and linear trends, and are as 
follows : 

ave {C. |.Y, ^ 1) = .,;. _^ \ _ , g (0(1) = 1, 

ave {Cr 1 -Y, ^ /} = .-— ^ E h(h + r) 

Jlc -f- 1 — r -k 

= I i2k(k + 1) - r(2k + 1) - /), 
where 

,2 



1 r r 

n- n n^ 



whence, 



ave [Cr\Xt^ a-\- m = Ki—r-, E (« + ^'')(a + I3h + 8r) 

Zlc + I. — r -k 



546 TriK BELL SYSTEM TECHNICAL JOURNAL, MARCH 1958 

while 

c -\- a -\- I -r. ^ 

a + b+l^c + rf+1 -c 

2 , ^ /d — c -}- b — a\ I ^2 (rf — c)(b — a) 
= a -\- 



,„ p -' + ''- " ) + 0^ 



From the first t,wo formulas, as combined in the fourth, we learn what 
dependence on a and /3 is required if we are to reject both constants and 
linear trends for any fixed value of r. The fifth formula, as developed 
into the last, shows that this cannot be done by subtracting the product 
of any two simple, equally weighted means of the X's. 

Suppose now that k = 3/ - 2, so that the means of the lower one- 
third of all, of the upper one third of all, and of all .Y's arc, respectively 

2j - 1 -k 

2j - 1 3 

1 *= 
X = Z^ Xh , 

(y - 3 -t 

and so that, wlien Z, ^ a + 0t, we have 

jF = a- /3(^) - « - (2i - 1)^ = « -l^, 

X = a. 
Thus if we wish to reject a constant we may choose 
Eor ^ {Xf (independent of r) 
and have 

ave {Ct I X( = a) = ave [Eor \ Xt = a]. 

This choice, however, produces no rejection of Xt = ^t at all. 

If we wish to reject either a constant or a linear trend or both in a 
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simple way, we may choose 



547 






for which 



ave \Cr I X, ^ 0L + ^t\ = ave \Eir \Xt = ci + /3f}. 

An alternate calculation, nearly equivalent to the use of Enr is il- 
lustrated by 



1 



•Ik + 1 - r tr 



E (X. - X){X,^r - X) 



2k + 1 - r t: 



2_j XhXh+r — X 



k 



IrX - E X, rX - Z X, 



+ 



—k 



1 



2k^-\ - r^ 



2k -\- \ - r 2k+ \ - r 

k-T 

2_/ X/,X;,_|_r ^ X" — XQr , 



where 



'^-2^TT^ 



k -fc+r-l 

2rX - E X, - £ X, 

t-r+l -k 



Tluis sul)tr;H'ting the mean of all the observations from each oliservation 
l)cfore forming the C^'s is equivalent to using 

E2r = X- + XQr . 

Similarly, fitting and subtracting the elementary-least-squaros straight 
line corresponds to 

^ - 3 



Eax, 



12 



/;(/.■+ 1)(2A-+ 1) ,i{n-- 1) tr 



Z hXu , 



and 



1 



o; _L ■ 2] (X;, - X - i3h)(X\^. - X - I3(k + r)) 

2A ■ + 1 — r -t 

i;x,x,,+. -X-- Xr^, 



2/.- + 1 - r -;.. 

it 



+ ^ t (/. + ,■) ■ (-Y. - X_„) - 'l( ["^f^ - K,] . 
II — r k-r+\ 12 \_n{n — r) J 



■]- 
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Thus linear fitting corresponds to the use of 

E,r = X'+XQr ^ E U + r)-{X, - X_,) 

n — rk-r+i 

r^l [ 2{n' - 1) _ 
"^ 12 L n{n - r) 

and if we wish to simphfy computation by neglecting "end corrections", 
consider 

E*,r = X' -\-XQr + '^ Kr. 

Another version can be obtained by recalling the usual formulation of 
a sample estimate of a (^ovariance between two unlagged variates. If we 
write 

2/c + 1 — r -fc 
then we are led to use the expression 

„, ■ \ E (X, - z^w)(x.+. - x^(.)) 

2k -{■ 1 — r ~k 

= 2/. + 1 - r § ^"^"^^ - ^^"^^'^"""^ 
which corresponds to the use of 

or, in the case of a linear trend, perhaps, to 

(The E's corresponding to fitting a separate straight line to X_a- , ■ • • , 
Xk^T and to X^t+r , ■ ■ ■ , Xt do not seem worth writing down.) 

Having now obtained a collection of quadratic expressions which, when 
subtracted from the corresponding Cr , remove the average effect of 
trend, we Jmve now to learn wliat effect these subtractions will have on 
the contribution of the fluctuations to the average values of the cor- 
responding quantities. As noted at the beginning of this section, it 
suffices to consider pure fluctuations, so that we need only study the 
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Spectral windows corresponding to the Etr , and to their finite cosine 

transforms. 

If we consider white noise (of unit variance) for a moment, the Xk 
become independent with average zero and unit variance and we can 
calculate the average values of the various E^r in an elementary way. 
This is of interest, iiecause these average vahies for white noise are 
exactly proportional to the integrals of the corresponding spectral win- 
dows. We find the following results: 

Approxi- 
Quadnilie , miition 

exprei^sion Average value for unit white noise to this 



Eor 

Eir 
E2r 



1 1 

n n 



l{}-^ 



2 
n 



1 1 

n n 



n \ V? — \ / 



E. 



2 
n 

n - 2r 1 



4r 



(71 — r)- n 



(n - r)' n' - 1 \ n^ / 



2 

n 



The quadrati*; cxpres-sions which eHminate the average effect of a con- 
stant trend (one constant) have spectral windows integrating approxi- 
mately proportional to 1/n, while those which compensate for general 
linear trends (two constants) integrate approximately proportional to 
2/n. This is simple, and seems straightforward. 

It is possible, however, to eliminate the average etYcct of a centered 
linear trend (one with a ^ 0) by subtracting a windowless ([uadratic 
expression, one whose average vanishes for all stationary ensembles. We 
need only consider 

X_2-Y„ - 2X_,Xi + XnXo 

whose a\'erage \'ahu' clearly vanishes under stationarity, Init whose 
value when X, = a + j3/ is 2l3-, to see that this is so. (Cursory imiuiry 
into variability suggests that such use of windowle.ss quadratics may 
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increase the variability of the finally resulting spectral density esti- 
mates.) 

Leaving such possibilities aside, let us compare the E^t for k = 0, 1, 
2, 3, 4, 5. The corresponding spectral windows can be written down with 
the aid of the formulas of Section A.6, but us they are rather compli- 
cated, we shall avoid doing so. The three choices eliminating constant 
trends, Eq, , E^r and E^r , all have integrated spectral windows approxi- 
mating l/n. The dependence on r is in any case weak, and where present 
increases with r. For Ear there is no dependence on r. 

We are, of course, more concerned with the spectral windows asso- 
ciated with the modified Fr's rather than with those associated with the 
modifj'ing Ekr - If we use Eor , then the change in spectral window is the 
same for each lag. Consequently, only the Rm{f) window is affected, the 
Rcrif) wiiidou's corresponding to the other Vr vanish. The situation is 
more complicated for the other cases, and no clear advantage over the 
use of Ear appears. 

The spectral window corresponding to X^ is, of course, (dif n//dif /)^ 
and is both always positive and well concentrated near zero. (If we re- 
placed X by the average over a graded data window we could decrease 
the corresponding spectral window for / beyond the first side lobe of 
dif nf, l>ut the concomitant broadening of the main lobe would make the 
result much less useful.) Clearly the use of E^r will be quite satisfactory. 

Comparing Eir , E-ir and E^r is not so simple. Etr has the smaller 
integrutetl spectral window for r/n small, but the simplicity of calcula- 
tion of Eu will often outweigh tliis facit. (If economizing on the spectral 
window is important, we could use a windowless quadratic to eliminate 
the average effect of /3.) Accordingly, the use of Eu is I'ecommended, 
unless it is simpler to subtract a fitted Unear function from all Xi . 

(There is no Section B.20.) 

B.21 Sample Computing Formulas 

Only the formulas for correction for prewhitening and for correction 
for the jncan require discussion. The factor for 1 ^ r ^ m — 1 is exactly 
the reciprocal of the prewhitening transfer function, calculated at the 
nominal frequctuw of the estimate. The factor for r = m, and the main 
portion of that for r = 0, differ only in the selection of the frequency at 
which the prewhitening transfer function is cvaluatCLl. Since, in each 
case, the nominal t'reqiiency is at one edge of the band of frequencies 
covered, the fro(|uency of evaluation was displaced from the nominal 
freiiuency toward the center of the corresponding band. The choice of a 
point one-third of the way across the band was somewhat arbitrary. 
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Finally, ihv.va in Ihc tiupstion of compensation for the correction for 
the mean. The raw estimate for r = would naturally be thought of as 
corresponding to tlu; interval from — l/(4m) to +l/(4m) cycles per 
observation, while the hamied estimate would cover from — l/(2m) to 
+ l/(2m) cycles per observation. Since n degrees of freedom are asso- 
ciated with tlie entire interval from — | to +| cycle per observation, 
the banned estimate for r - is associated with n/m degrees of freedom. 
One of these has been eliminated by correction for the mean, as would 
also have l)een tlic case had we used E-2r or Eir , so that we need to com- 
pensate for a reduction in the ratio 

^ -1 

m n — m 



n 
m 



whose reciprocal is the first compensating factor for r ^ 0. (Had we used 
Eir , E-ir , or Etr , we would have had to compensate for the loss of two 
degrees of freedom by a factor n/{n — 2m).) 
(There is no Section B.22.) 

Details for Planning 

B.23 Duration Requirement Formulas 

We are now in a position to assemble and modify formulas from a 
number of sections as a basis for formulas expressing explicit require- 
ments. In the process we shah have to give explicit definitions for certain 
concepts. The first of these is resolution. If we hann or hamm, we obtain 
estimates every l/(27'„) cps. Adjacent estunates have very considerably 
overlapping windows, and consequently the estimates have substantially 
related sampling fluctuations and refer to overlapping frequency regions. 
It would be a clear mistake to consider these estimates as completely 
resoh'ed. When we come to next-adjacent estimates, however, the situa- 
tion is quite different. The overlap is small, the covariance being about 
5 per (-ent of either variance for a moderately flat spectrum. We shall 
consequently treat such pairs of estimates as completely resolved, and 
place 

(resolution in cps) ^ 2 -=- = ,,, . — r- ■ 

^ 2T^ J\n in seconds 

We can express the stability, so far most often expre.sscd as the num- 
ber of elementary frequency bands or equivalent degrees of freedom 
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associated with each estimate, in tenns of the spread in db of an interval 
containing, with prescribed probability, the ratio of true smoothed power 
to estimated smoothed power. Reference to Table II in Section 9 
shows the inter-relations to be, approximately 

/o — 1 -(- 



k = i + 
/c - 1 + 



(80 per cent range in db)-' 

^0 

(90 per cent range in db)-' 

625 

(96 per cent range in db)*^* 

840 

(98 per cent range in db)- ' 



We shall write onr combined formulas in terms of the 90 per cent range. 
Formulas for other per cent ranges are easily obtained by replacing 400 
by the appropriate constant. It must be emphasized that when we use a 
90 per cent range we only have 9 (chances in 10 of finding each individual 
estimate correspondingly close to its average value and that if we have, 
say, 30 estimates, we are quite sure that at least one will be more dis- 
crepant than this. 

We recall that we adopted (see end of Section 6 of Part I) 

Tn = (total length of record) — ^ 7\„ , 

where p was the numlier of pieces, and, for design purposes. 

Hence, 

(duration in seconds) ^ T„ - (|J^ + | j T,,, 

1 



= (M) 



(resolution in cps) 

= (n + 77^7^ r~ ■ Au\2 + ^^^^ ) / (resolution in cps). 

\2 (90 per cent range m db)^ 3 // 

Writing (length of each piece) ■ (number of pieces) for (duration) and 
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solving for the number of pieces yields 



1 200 



, . _ „ . . _ 2 (90 per cent range in db)'' . 

(length of eaeh piece)(resolution in cps) — | 

These relations are general, and apply equally to analog processed con- 
tinuous records or digitally processed etiui-spaced records, provided the 
spectrum is, or can be prewhitened to be, reasonably flat. 

B.24 Digital Requirement Formulas 

If we are to use equi-spaced digital analysis, if we can provide fre- 
([uency cutoff easily, and if we need to (;over frequencies up to some 
.fnia^ , then we can probably take our folding frequency at about f/maK - 
The necessary number of lags m then follo^v from 

3/niax 2/flf 

The necessary numl^cr of data points follows from 

= (3^ + p)(r./„,j, 

and the rough niuuber of multiplications is 

The (quantity !r,„/,„nx can be written as 

U^ ^ maximum iix-quency ^ ^^^^^^^,^^^. ^^ ^.^^^^^^^ ^^^^^^^^ 
1/lm resolution 

so that the number of data pomts becomes 

/ T' \ 

n — ( 3 -^ + p I (number of resolved bands) 

^ (1.5/,; + p) (number of resolved bands), 



Second differencos of Brouwer 
timation process as applied to 



Table VII 

's data and the add-and -subtract pilot es- 

them. (Block 2 only.) 



Date 


lOF* 


diff. 


Znd diff. 


s 


0- 


5tr 


ircr 


fiffff 


ciTir 


DXg 


1853.5 


56 





















1854.5 


56 


-4 


„4 


4 


-4 










4 


1855.5 


52 

48 
42 
41 
36 


-4 
-6 
-1 
-5 

+2 



-2 
+5 
-4 
+7 


7 
11 


3 
3 


7 
-9 


-1 

-3 


-2 


-4 


-2 

7 

-9 

11 

-30 


1860.5 


17 

13 

7 

-5 


-21 

-4 

-6 

-12 

-11 


-23 

+ 17 

— 2 

-6 

+ 1 


40 

-4 
+8 


-6 

-8 

10 


18 


2 






40 

-19 

-4 

+7 

+s 


1S65.5 


-16 
-18 
-31 
-42 
-52 


-2 
-13 
-11 
-10 
-23 


+9 

-11 

+2 

+ 1 

-13 


+ 13 
-14 


-9 
-12 


-3 


-21 


-23 


-10 


-20 

+ 13 

-1 

-14 

+15 


1870.5 


-75 

-96 

-108 

-131 

-149 


-21 
-12 
-23 
-18 
-9 


+ 2 

+9 

-11 

+5 
+9 


+ 7 

+ 16 

-9 


11 

-6 

9 


-17 


5 


4 


14 


+7 

-20 

+ 16 

+4 

-9 


1875.5 


-15S 
-167 
-172 
-181 
-186 


-9 
-5 
-9 
-5 
-11 



+4 
-4 
+4 
-6 


-8 
-10 



-2 


-9 
6 


9 
2 






+4 

-8 

+8 

-10 

+ 15 
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Table 


VII, 


Continued 










Date 


lOF* 


diff. 


2nd diff. 


6 


" 


5c 


.a 


iaa 


aaa 


/..Y, 


1880.5 


-197 
-199 
-206 
-224 
-220 


-2 
-7 
-18 
+4 
-4 


+ 9 

-5 

-11 

+22 

-8 


-14 

+33 
+8 


4 

11 

-8 


-19 


3 


1 


5 


-14 

-6 

+33 

-30 

+8 


1885.5 


-224 


-4 



















1886.5 


-228 





















• (Biouwer'a notation) is the fluctuation in the earth's rotJition. Here lOF 

is the fliuitiiatioii expressed in tenths of seconds of time. 



and the rough nuinljci- of multiplifations liecoinos 
nm = (4.5/o + ;jp) (number of re.solved bauds)" 

'9 , 1800 _L or ■ 

_ + — r-— + ^(pieces 

2 (i)0 per cent range in db)- 



■>] 



• (number of resolved bands)'. 

These last formulas assume satisfactory shaping of frequency cutofT, find 
constant resolution up to the maximum frequency of interest. Particular 
situations may deviate from this in either direction. 
(There are no Sections B.25, B.26, B.27.) 

B.28. Analysis of Example C 

It is most desirable that an account of this sort include enough details 
of a numerical example to allow those readers who wish to do so, to fol- 
low through and check. This is impractical when even a few tenths 
(or even a few hundredths) of a million multiplications are involved. 
Example C, however, offers us an opportunity to present such details for 
one example, even if it is quite atypical. 

We remarked in Section 28 that the add-and-subtraet pilot esti- 
mation procedure of Section 18 inight be applied to the second dif- 
ferences of Brouwer's values (themselves the differences ephemeris 
time minus niean solar time). During the 131 years from 1820 to 1950 
astrononucal techniques have improved, and observational errors seem, 
according to Brouwer's own analysis, to have somewhat decreased. In 
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Table VIII — Sums of Squared Differences 





S column 


Sa column 


Sua column 


(■) 


(t) 


Block 1 


8615 


2083 


321 


-502 


-971 


Block 2 


4130 


1230 


550 


-9 


-70 


Block 3 


3447 


2591 


273 


1557 


-244 


Block 4 


1553 


304 


516 


-162 


283 


Noise 


5/2 


3/4 


3/8 








Flat 


1 


1 


1 


0.7 


0.85 



(") Sum for &j column less 0.3 time-s .sum for 5 column, 
(t) Sum for Saa column le.s.s 0.15 times sum for 5 column. 

order to reflect this fact, and to provide some external estimate of error 
we shall study the second differences in 4 separate blocks, 4 separate time 
intervals of '^2 consecutive years each. In view of the fact that Brouwer 
estimates the mean observational error to have decreased from 0.38 to 
0.17 seconds of time over the period, it will clearly suffice to work in 
units of 0.1 second of time. Table VII shows, for the second time block, 
calendar dates, Brouwer's values, their first and second differences (the 
latter being the series we consider as the Xg) and the results of the add- 
and-subtract pilot estimation model. In this table, sums and differences 
are shown on lines half-way between the lines containing the entries from 
which they are formed. The last column shows the result of com- 
pleting the 5X5 column to a DX^ column. The resulting sums of squared 
differences are shown in Table VIII for each of the four blocks, together 
with comparative values. 

These comparative values show the anticipated relative sizes of such 
sums of sfiuared differences in case the spectral density were 

(1) proportional to {1 — cos irf/f^)' = {1 — ii)\ the shape assumed 
for the "noise" component, 

(2) flat, the shape assumed for the other component according to the 
second model, 

where we ha\'e introduced u as an abbre\'iation for (^os tt/Z/at . The suc- 
cessive columns have average sums of squared differences which are 
easily seen to be obtained by multiplication of the spectrum by (when 
we start with 32 A"s) : 

10 (2 - 2 cos 7rf//iv) - 32 (1 - m), 
8 (2 -f 2 cos Tcf/J^) (2-2 cos 2jr//A-) - 04(1 + u - xC - ii') 

= 64 (1 + u) (1 - u'), 
4 (2 + 2w) (4h ) (10 u' - 10 u') = 512(tt + w' - u - «'), 

and integration. 



MEASUREMENT OF POWER SPECTRA 557 

When we recall that 

vanishes for odd k, and is equal to fs , /,v/2, 3/^8, o/jv/lG and 35/Ar/128 
respectively, for k ^ 0, 3, 4, 6 and 8, \ye easily obtain the values given 
for comparison iu Table VIII (after removing 32/,v as a common factor). 

The last two columns of thLs table represent attempts to combine 
smns of squared differences so as to estimate the first component free of 
the "noise" component whose spectrum is proportional to (1 — ti)^. 
The attempts appear (|uite useless. 

One reason for the lack of success is easy to find. There are only 4 
values of Sa-a to square and sum for each 32-year block. This means no 
more than 4 degrees of freedom, and, consequently very poor stabihty. 
We can partially correct this difficulty by going over to the modified 
add-and-subtract method in which all possible differences of a given sort 
are cahmlated. 

Table IX presents the compact calculation for block 1, arranged as 
in Table VI. Here (cr) stands for first a and then a-'. The mean squares 
for each cohmni of differences lead to the results summarized In Table 
X for all four blocks. The difference estimates are now seen to he more 
stable and to increase somewhat with decreasing frequency, although 
not as much as would be expected even for a flat component. 

The analysis is doing better, but is not yet satisfactory. One likely 
reason for this appears when we inquire what sort of spectral windows 
go with (*), (t) and (J). The windows corresponding to D{a) and to (*) 
are shown in Fig. 24. The amount of negative area near f/fij ^ 1 re- 
quired to compensate for the rather large pickup of the "noise" com- 
ponent ljy the D((t) column is quite substantial, suggesting probable 
increased variability. 

We can reduce our difficulties from such cau.ses by using only slightly 
more complex processes. We can probably use the D column satisfac- 
torily as an indication of the noise component. 

We need to obtain two other composite measures of the spectrum, 
both of ^\-hich avoid large values of f/fn , one of which is concentrated 
near ///a- = and the other of which avoids ///y = 0. If we can obtain 
a smoothed and decimated se(|nen(^e which avoids the upper part of the 
spectrum, then sums and differences of such values wUl have mean 
squares with the appropriate properties. The results of Section B.18 
suggest trying F-nS-'S-^ as the operation generating the modified sequence, 
to which D (differencing) and -S2 are then to be applied. 
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Table IX 
Compact calculation applied to second differences (in tenths of seconds 
of time) for block 1 (values in Brouwer's Table VIII(c) used where ap- 
propriate). (Entries arranged as in Table VI.) 



X, 


D 


(t) 


DM 


{")' 


DW 


("V 


Z)W» 


W 


D{<r*) 


-27 




-6 




-10 




-10 




-9 






+48 




2 




10 




11 




13 


+21 


-27 


-4 


4 





-6 


+1 


-5 


4 




-6 


+8 








-6 


13 


-4 


12 






+2 


-8 





-1 


7 


-12 


8 




-3 




-6 


+12 


-1 


-4 


-5 


6 










+6 


+2 


-5 


6 


1 


1 


-G 


8 


-4 




+8 


-16 


1 


5 


2 


4 


2 


1 






-8 


+ 1 


6 


-10 


G 




3 




5 




-7 


+ 13 


-4 


3 














+6 





-1 


3 


-4 


3 


-5 


3 


-7 




+6 


-17 


2 


-3 


-1 


-3 


-2 


24 






-11 


+ 16 


-1 


23 


-4 


6 


22 




20 




+5 


-9 


22 


-42 


2 


-1 










-4 


+8 


-20 


15 


1 


20 


-5 


8 


-2 




+4 


-2 


-5 


16 


21 


-46 


3 


-7 






+2 


+6 


11 




-25 




-4 




-1 




+8 


-20 


















-12 


+23 


15 


-19 


11 


-12 


10 


G 


2G 




+ 11 


-23 


-4 


18 


-1 


7 


16 


-23 






-12 


+31 


14 


-29 


6 


4 


-7 




9 




+ 19 


-36 


-15 


27 


10 


-4 










-17 


+27 


12 


-18 


6 


-19 


5 


11 


21 




+ 10 


-21 


-G 


6 


-13 


24 


16 


-18 






-11 


+ 16 





10 


n 




-2 




14 




+5 


+ 12 


10 


-11 
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Table IX, Continued 
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x„ 


D 


(.) 


DM 


(cr)' 


DM^ 


("? 


DM' 


M' 


«{»<) 


+17 


-45 


-1 


8 


10 


-13 


7 


-4 


10 




-28 


+36 


7 


-14 


-3 


-3 


3 


-20 






+8 


+6 


-7 


1 


-6 


15 


-17 




-14 




+14 


-33 


-6 


-5 


9 


-9 










-10 


+2S 


-11 


33 





-17 


-9 


IS 







+9 


— 7 


22 


-32 


-17 


29 


9 


-14 






+2 




-10 




12 




-5 




4 





Table X — Mean Squares for Difference Columns and Suitable 

Linear Combinations Thereof for the Analysis 

Illustrated by Table IX 



Block 


D 


DM 


DM'' 


DM' 


(•) 


(t) 


(t) 


1 

2 
3 

4 


485 

252 
207 

76 


283 

207 

258 

41 


234 

206 

145 

80 


176 

317 
148 
106 


-8 

56 

134 
-5 


-57 

55 

21 
34 


-115 

1 60 
24 

60 


Ave. of 2, 3 


and 4. 








51 


38 


78 


Noise 
Flat 


5/2 
1 


3/2 
2 


3/2 
4 


3/2 
8 



1.4 




3.4 



7.4 



{*) Mean square for D(a) less 0.6 times that for D. 
(t) Mean square for D{aY l^ss 0.6 times that for D. 
(j) Mean .square for D{a)'^ less 0.6 times that for D. 

The corresponding windows are, for the square of a single \'ahie of 

4i/'(2 + 2u) (1 + 4ji + \u-) - 8(u' + 5».' + Sw* + ^w"), 

and, for the square of a single value of DiF^SzSzXq , 

(4 - 4tr)(2 + 2h) (1 + 4« + 4(r) - 8(1 + ou + Tir - u - Su - 4u), 

to which .should be compared that for the square of a single \'alue of 
DXg 

(2 - 2u) = 2(1 - «)■ 
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1.2 
I.I 
1.0 

o.g 

0.8 
0.7 
0.6 

0.5 
D.-l 
0.3 
0.2 
0.1 

-0.' 



0,1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1.0 

Fig. 24 — Windows correspoading to />(ct) and to (*). 

If now we form all values of S2{F2}S2S3X^ , I»(/^2)»S2S.,X, and DX, 
(Table XI illustrate.s the parallel calculation of F2 and F2 ciuantities), 
and form the corresponding mean squares, we obtain the results shown 
in Table XII. 

If we compare the S-Q.28 column with the last column, we find a 
definite tendency for the last to be smaller. As indicated by the last 
two lines of the table, neither of these columns reflects, on the average, 
a "noise" component, while, on the average, both reflect a "flat" com- 
ponent equally. The natural conclusion is that the observed spectrum 
is more peaked toward ///w = than would be expected from a mix- 
ture of "flat" and "noise" components. It might seem natural to (con- 
clude that the first model is to be preferred. 

However, more careful examination shows that not only do the 5 
mean squares appear to decrease with improvements in astronomical 
technique, but {leaving aside block 1) the values in the R-0.25 column 
are decreasing and those in the D-0.66 column may well be doing the 
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Table XI 

Calculation of Si(F2)S2S3 and D(F-^S-2S:, for the second differences of 
Brouwer's fluctuations in the earth's rotation. (Portion of block 2.) 











CK 


D, 






& 








o, 


>'. 


'■< 


» 


^ 


>i 








>; 


^ 


to 


t-^ 


^ 


'^ 


Date 




Cr 


|>j 


lo' 


tn 


^ 


^' 


<^ 




(J 


'--; 


^' 


t,' 


^ 


^ 


'"l^" 


"(C 




^ 


<^ 


li,' 


Q 


^ 


'■^ 


Q 


^ 


1854.5 


-4 
















1855.5 




-2 
+5 

-4 

+7 


-6 
+3 
-1 
+8 
-20 


-3 
+7 

-ly 


+ 10 
-26 


+4 
-12 


2 
-12 


-14 
+5 


-10 
-19 


1860.5 


-23 

+ 17 

-2 

-(i 

+ 1 


+ 1 
-S 
+'J 

-7 
+4 


+1 

-3 


+20 
-4 
+2 


-18 
-2 
-4 


— 7 
2 
3 


+9 
+ 1 


-5 
5 


1865,5 


+y 
-i: 

+ 2 

+ 1 

-13 


-1 


-S 
-10 
-10 


-1 

-18 
-12 


-17 
+6 


-19 
-30 


-8 
-20 


-11 

-12 
18 


-5 

-28 
-22 


1S70.5 


+2 
+9 
-11 
+5 
+9 


-2 



+3 

+3 

+ 14 


3 

17 


15 
14 

-4 


-9 
20 

30 


-2 
G 

27 


8 
21 


4 
33 


1875,5 



+4 
-4 
+4 
-6 


+ 13 



+4 

-6 

+7 


13 
-2 


-15 


11 


4 
1 


-23 
-3 


31 
5 


1880.5 


'J 
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Table XII — Mean Squares of Columns for Second 
Differences of Brouwer's Data 



For 


S 


D 


s 


S-0.2S 


D-Q.6B 


2.5 (D-OM) 


Block 1 

Block 2 
Block 3 
Block 4 


83 

290 

153 

62 


228 

178 

168 

47 


484 

252 
207 

75 


-14 

240 
112 

47 


-62 

27 

44 

2 


-155 

68 

no 

5 


Average (2, 3, 4) 


168 


131 


178 


133 


24 


61 


Noise 
Flat 


1 

28 


3 

12 


5 
2 




27.6 



10.8 



27.6 



S = meiiii square value of S'i(F2)S2SiXg . 
D = meau square value of D(_F2)S2S^Xg . 
5 = mean square value of DXg . 

same. The suggestion is — which, after we have seen another block or 
two or three (of 32 years each), we may bo able to confirm or deny — 
that the lower frequency component, as well as the noise component, is 
decreasing as astronomical technique improves. If this be true, then 
most of the low-frequency power in blocks 2 and 3 may represent ob- 
servational and reductional sources of variation rather than changes in 
the rotation of the earth. 

"While more refined analyses might show something more, 131 values 
are not a great number, especially since technique has changed during 
their measurement, and it is likely that we shall have to wait a while 
for a more definite answer to this question. 

This example was included, not because of the peculiar importance of 
the irregularities in the rotation of the earth, but rather to illustrate 
certain general points, particularly these: 

(1) While careful spectral analysis requires a very considerable amount 
of arithmetic, there are situations where simple analysis will yield useful 
results. (All the values in this section were obtained with pen or pencil 
and an occasional use of a slide rule. The use of simple differencing and 
sununing techniques to produce moderately sharp windows has been 
studied by the Labroustes.''^' "-■ ^^ Although they felt themselves in- 
terested in hne spectra, their methods, properly reinterpreted, are easily 
and directly applicable to continuous spectra.) 

(2) The windows corresponding to the add-and-subtract pilot analysis 
are broad and the estimation far from exhaustive. (The procedure is 
intended for use in planning prewhitening, not as a tool for answering 
questions of even moderate difficulty.) 

(3) Subdivision of the data before analysis is quite often helpful. 
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(If blocks 2, 3, and 4 had been analyzed as one unit, it would have been 
easy to jump to a (conclusion which now seems dangerous.) 

(4) Spectral analysis can lead to results unsuspected before the cal- 
culations were made. (The decrease in amplitude of the low-frequency 
component which Hrouwer's data now suggests was not at all suspected 
until the values given in Table XII were pulled together.) 

Index of Notations 

In case a notation is not widely used, the Sections in which it is used 
are specified in parentheses: 
a — an integer (A. 6 and B.19), 
flo , fli , 02 ^ real constants (B-8.4), 
ctio , fl.-y = as.sorted constants {13 and B*.5), 
A = various constants (27, B.9, B.15), 



Aif; — J = infinite Dirac comb made up of unit 5-functions spaced 1/Ai 

in frequency (see A. 2 or Table IV for formula), 
fc = an integer (A. 6 and B.19), 
B ^ auxiliary (quantity defined in B-8.5 (B.8), 
B(t), Bi{t), B{t) - a data window (graded) (10 and B.IO), 
c — an integer (A. 6 and B.19), 
Co , Ci , ■ ■ ■ , Ck = real constants (B.15), 
Cij = autocovariance corresponding to ti and tj (1), 
C(t) = autocovariance at lag r, 

Cm(t) = autocovariance estimated from record of finite length, 
Coq(t), Coii(t), etc. ^ hypothetical or actual analogs of Coo(t), 
dir) = Di(T)C(,o{T) = modified autocovariance estimate (defined in 4), 
Cr = sample autocovariance at lag rAr (usually ^ rAt in practice), 
d - an integer (A.G, B.18 and B.19), 
D = the operation of differencmg adjoining values, 
Diir) = a prescribed even function of time shift, often a lag window 

(cp. 4, 5, B.4, B.5), 
D,^(t) ^ lag window equi\-alent of Biir) (see B-4.11 for representation), 
e - 2.71828182845 ■■■ , 

^kr — /v'''' alternative correction at lag r (19, B.19), 
/ = frequency (in cycles per second where not otherwise specified), in 

equi-spaced discrete situations / = r/{2m-At) ^ {r/m)Jt, , 
/o ^ a particular frequency (in Section B.18 the folding frequency of 

the cycle in question), 
/i = a frecjuency, often the nominal frequency of a smoothed estimate, 
/jv = Nyquist or folding frequency — 1/(2 -Ai), 
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/ft,* = effective Nyquist or folding frequency ^ l/(2-Ar), (13), 

Fj = the operation of retaining only every j"' value {j - 2, :-}, ■•■) 

(B.19, B.28), 
F2 ^ the operation of retaining the alternate vahies dropped by F2 

(B.19, B.28), 
g = an index running from — c to -\-d (A.6 and B.19), 
G{i) = a function of the time, Fourier transform of S(f) (correspondence 

also required with subscripts 0, 1, 2), 
Q[t) = the Fourier transform of a particular box-car function (B.12), 
h ^ an integer, generally satisfying At = h-At, in A.6 and B.19 an 

index running through indicated ranges, 
Hi(f; /i) ^ Qiif + /i) + Qi(f - /i) - Po^^^^i' ti-ansfer function (from 

power at absolute frequency / to estimate at nominal frequency /i), 
Hiif " /i) = special form of Hi(f; /i), 
Hyif; /i) ^ power transfer function defined in B-10.2, 

Subscript i, values often 0, 1, 2, 3, 4, usually identifies quantities or 

functions associated with i' ' window pair, 
j ^ an integer, often such that 3^ — 2 ^ k or ( (B.19), 
Subscript J, values often 0, 1, 2, 3, 4, alternative to subscript i, 
k ^ usually number of equivalent degrees of freedom or number of 

elementary frequency bands; in Section 17, length of group 

averaged, 
-f = an integer; in 18 an exponent of 2, in A.6 satisfying n ^ 2C -\- 1, 
L = inductance (in example of 27) , 

m - integer, number of longest lag (longest lag = m ■ At, usually - mM), 
M{t, t) — bilinear monomial in the X's 

^ X(f + T/2)-X(t~ r/2), 
71 ^ usually one less than the number of discrete data points, in A.G 

and B.19 an integer - 2f + 1, 
n' = effective length of record (n' ■ At = T'„), 
■p ^ usually the number of pieces of record; also = to (A.l only); a 

real number (usually integral, A.6), 
po ^ a constant power density (B.9), 
Po , pi , P2 , ■ ■ ■ ^ ordinates in general example (9), 
p(f) = density of power spectrum (normahzed so that variance = 

/? 2P(/) df), also with various subscripts, 
Paif) = aliased density of power spectmm (periodic in frequency, cp. 1 2), 
P^{f) = principal part of aliased density of power spectrum (confined 

to I/I ^ 1/(2 -At), cp. 12), 
Py{fi) - estimate of spectral density based on filtered signal (B.IO), 
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P^i(f) ^ Spectral density estimated with the data window Bi{t), 

Poo(f) = synilioHc Fourier transfoi'ni of C'oo(t), 

PqaU) ^ aliased estimate of smoothed Pij), 

p.j(/) = H,{f;fi)P{f), roughly a filtered version of P{f) (subscript i 

interchangeable with j, also 1 with 2), 
PiA(fi) = aliased estimate of smoothing of P(f) by Hi(f;fi), 
/>,.,,,(/) ^ HiU;fi)-pA{j) = ahased filtered spectral density, 
PiAki!) = corrected aliased estimate of P{j) smoothed liy Qi(/), 
V',.u(/;/i) - I 5'(/;/i) l'-^(/) = spectral density of output, 
P[f) = a perfectly known power spectrum (B.12), 
p^(j) = either the aliased spectmm corresponding to P{j) (B.12) or 

the aliased spectrum of the X^ series (15, 17), 
/',^(y) = an axixiliary quantity defined in B-8.4, 
q = index running as indicated, 
Qr = an auxiliary (luantity (B.19), 
Q(,(/) = Fourier transform of centered box-car function of length 27"™ 

(See also (?,{/) for?), 
(l.{j) = Fourier transform of R.(t) (see B.5 for i = 0, 1, 2, 8, 4 and 

B-8.7 for another choice), 
Qi){j\ At) ^ spectral window corresponding to (Fourier transform of) 
a discrete box -car function, 
= At-cos ^(■uj-At) sin (mw-Ar), 
Q.'iU) = spectral window corresponding to (Fourier transform of) Z),.i(r), 
QU!) - aliased form of (A(/) - Qaif-Ar), 
QiAil) = aliased form of Q;(/), 
Quif), Qiil) = auxiliary quantities (B.8), 

r = integer index almost always running from or 1 to m or m — 1, 
li = resistance (in example of Section 27), 
/(• .^(/) = spectral window associated ^vith (?,(/) and the sequence E^o , 

Sj = operation of summing by (overlapping) sets of j each (B.17, B.28), 

S{f) = function of frequency, Fourier transform of G{t) (also with sub- 
scripts 1,2, ■ ■ -). 

,S(/) = a particular box-car function (B.12), 

/ = time in the sense of epoch (also with various subscripts), 

T = a time, usually positive, 

T„, = half-length of box-car function of time, or greatest lag used or 
considered, 

Tn = length of record, 

T'„ = cfTective length of record, approxhnately T„ - - T,„ , 
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w ^ general real variable, 

f ', = corrected estimate of smoothed power density (at nominal fre- 

(juency r/{2m-At), 
Vr ~ raw estimate of smoothed pouer density at nominal frecincncy 

r/{2m-M), 
w = a chance quantity (B.6), 
W = a. frequency band width (B.9), 

We = equivalent width, often of Puif) defined in Section 8, 
trmain ^ Width of maiii lobe, 
Wanie = width of sldc (unspUt) lobe, 
W{t) = impulse response of linear transmission system, 
^(^;/i) ^ in B.IO the impulse response of filter with transfer function 

X = usually a real variable, in B.6 a chance quantity (random variable), 

Xg = gth value of discrete, equi-spaced time series, 

X{t) = value of time function, 

X = in Section 1 an average value (along an infinite function or across 
an ensemble), in 19 ff. the mean of the observed A'^'s, 

X+, X~ = means of end thirds of observed values, 

Xg , Xg* = gth values of linearly transformed time series, 

^ = in Section B.6 a chance quantity (random variable), 

^(/) = steady-state transfer function corresponding to linear transfor- 
mation or linear transmission system, 

z = in Section B.G a chance quantity (random variable), 

a — a real constant (15) or an indeterminate (B.8), or a certain frac- 
tion (B.18) or an unknow^n constant (B.19), 

ai = factor indicating extent of end effect losses (8, B.G) defined by 
B-G.9, 

Q ^ real constant (15) or an indeterminate (B.8) or a constant defined 
by B-8.8, or an unknown (slope) constant (B.19), 

/5 - estimate of /3(B.19), 

7 — real constant (15), 

r(/) ^ power-variance spectral density, 

rA((/) ^ power-variance spectral density in the equi-spaced discrete 
case, 

5 ^ operation of forming alternate differences, 

6' = operation of forming alternate differences complementary to 5, 

A/ = a change in frequency, sometimes the width l/(27'„) of an ele- 
mentary frequency band, 

Ai = time interval, usually that between data values, 

t!KT = time interval, usually that between lags used ( = /tA/), 
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€ = ii small real number (A.2), 

^ = real, time-like variable of integration (A.3), 

X ^ real, time-like variable of integration (A.3) or a real constant (15), 

jj. = real constant (15), 

c = real constant (15), 

w = angular frequency (in radians per second unless otherwise specified) 

always = 27r/ [with any sub- or superscripts], 
V = 27r/7'„. , a normalized frequency (B.8), 
$(y^ X) = fin iuixiliary function (B.6) (defined in B-6.3), 
^ = a phase angle (A.6), 

Xa" = a quantity distributed as chi-square on k degrees of freedom (9), 
a, a' = complementary operations of summing by adjacent parts and 

then omitting every alternate sum, 
T = time dilTereuce or lag, 
* — sign of convolution, 

superscript * = s^ign of complex conjugate (A.3), 
V(/; A^ = infinite Dirac comb approximating the constant unity 

[fornuila in A.2 or Table IV], 
V,„(^; AO = finite Dirac comb approximating a unit-height, centered, 

box-car function [formula in A.2 or Table IV]. 
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